Sep 10 19:35:36 devstack cinder-volume[77156]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 10 19:35:36 devstack cinder-volume[77156]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 10 19:35:36 devstack cinder-volume[77156]: we strongly recommend against using it for new projects. Sep 10 19:35:36 devstack cinder-volume[77156]: If you are already using Eventlet, we recommend migrating to a different Sep 10 19:35:36 devstack cinder-volume[77156]: framework. For more detail see Sep 10 19:35:36 devstack cinder-volume[77156]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 10 19:35:36 devstack cinder-volume[77156]: import eventlet # noqa Sep 10 19:35:39 devstack cinder-volume[77156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77156) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 10 19:35:39 devstack cinder-volume[77156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77156) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 10 19:35:39 devstack cinder-volume[77156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77156) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 10 19:35:39 devstack cinder-volume[77156]: INFO dbcounter [None req-11223291-6456-4f17-9989-f94971308a48 None None] Registered counter for database cinder Sep 10 19:35:40 devstack cinder-volume[77156]: DEBUG oslo_db.sqlalchemy.engines [None req-11223291-6456-4f17-9989-f94971308a48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77156) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 19:35:40 devstack cinder-volume[77156]: DEBUG dbcounter [-] [77156] Writer thread running {{(pid=77156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 10 19:35:40 devstack cinder-volume[77156]: INFO cinder.rpc [None req-11223291-6456-4f17-9989-f94971308a48 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 10 19:35:40 devstack cinder-volume[77156]: INFO cinder.rpc [None req-11223291-6456-4f17-9989-f94971308a48 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 10 19:35:40 devstack cinder-volume[77156]: DEBUG oslo_db.sqlalchemy.engines [None req-11223291-6456-4f17-9989-f94971308a48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77156) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 19:35:40 devstack cinder-volume[77156]: INFO cinder.volume.manager [None req-11223291-6456-4f17-9989-f94971308a48 None None] Determined volume DB was empty at startup. Sep 10 19:35:40 devstack cinder-volume[77156]: DEBUG cinder.volume.manager [None req-11223291-6456-4f17-9989-f94971308a48 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77156) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 10 19:35:40 devstack cinder-volume[77156]: INFO cinder.volume.manager [None req-11223291-6456-4f17-9989-f94971308a48 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 10 19:35:40 devstack cinder-volume[77156]: WARNING stevedore.named [None req-11223291-6456-4f17-9989-f94971308a48 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 10 19:35:40 devstack cinder-volume[77156]: WARNING castellan.key_manager [None req-11223291-6456-4f17-9989-f94971308a48 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 19:35:40 devstack cinder-volume[77156]: WARNING cinder.keymgr.conf_key_mgr [None req-11223291-6456-4f17-9989-f94971308a48 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 19:35:40 devstack cinder-volume[77156]: DEBUG cinder.volume.drivers.lvm [None req-11223291-6456-4f17-9989-f94971308a48 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77156) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 10 19:35:40 devstack cinder-volume[77156]: DEBUG oslo_concurrency.processutils [None req-11223291-6456-4f17-9989-f94971308a48 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:40 devstack cinder-volume[77156]: DEBUG oslo_concurrency.processutils [None req-11223291-6456-4f17-9989-f94971308a48 None None] CMD "cinder-rtstool verify" returned: 0 in 0.406s {{(pid=77156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_db.sqlalchemy.engines [None req-11223291-6456-4f17-9989-f94971308a48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77156) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 19:35:41 devstack cinder-volume[77156]: INFO cinder.rpc [None req-11223291-6456-4f17-9989-f94971308a48 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 10 19:35:41 devstack cinder-volume[77156]: INFO cinder.rpc [None req-11223291-6456-4f17-9989-f94971308a48 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 10 19:35:41 devstack cinder-volume[77156]: WARNING stevedore.named [None req-11223291-6456-4f17-9989-f94971308a48 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 10 19:35:41 devstack cinder-volume[77156]: WARNING castellan.key_manager [None req-11223291-6456-4f17-9989-f94971308a48 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 19:35:41 devstack cinder-volume[77156]: INFO cinder.volume.manager [None req-11223291-6456-4f17-9989-f94971308a48 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_db.sqlalchemy.engines [None req-11223291-6456-4f17-9989-f94971308a48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77156) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 19:35:41 devstack cinder-volume[77156]: INFO oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] Starting 1 workers Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] Started child 77308 {{(pid=77156) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] Full set of CONF: {{(pid=77156) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] ******************************************************************************** {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] Configuration options gathered from: {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] ================================================================================ {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] allow_availability_zone_fallback = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] allow_compression_on_image_upload = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] allowed_direct_url_schemes = [] {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] api_rate_limit = True {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] auth_strategy = keystone {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] az_cache_duration = 3600 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_availability_zone = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_host = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_name = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_stats_polling_interval = 60 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backup_api_class = cinder.backup.api.API {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backup_name_template = backup-%s {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backup_use_same_host = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backup_use_temp_snapshot = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77308]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] chap_password = **** {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] chap_username = {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cinder_internal_tenant_project_id = 7dacb7776a5b4ac794cc42e21588c999 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cinder_internal_tenant_user_id = 928ad658bcf14f8bb4ded8228bf462c0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cloned_volume_same_az = True {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cluster = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] compression_format = gzip {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] compute_api_class = cinder.compute.nova.API {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] config_dir = [] {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] config_source = [] {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] control_exchange = openstack {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] debug = True {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] default_availability_zone = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] default_group_type = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] default_volume_type = lvmdriver-1 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] disk_geometry = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] driver_client_cert = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] driver_client_cert_key = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] driver_data_namespace = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] driver_ssl_cert_path = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] driver_ssl_cert_verify = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] driver_use_ssl = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] enable_force_upload = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] enable_new_services = True {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] enable_unsupported_driver = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] enabled_backends = ['lvmdriver-1'] {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] enforce_multipath_for_image_xfer = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] filter_function = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] glance_api_insecure = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] glance_api_servers = ['http://192.168.122.138/image'] {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] glance_api_ssl_compression = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] glance_ca_certificates_file = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] glance_catalog_info = image:glance:publicURL {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] glance_certfile = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] glance_keyfile = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] glance_num_retries = 3 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] glance_request_timeout = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] goodness_function = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] graceful_shutdown_timeout = 5 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] group_api_class = cinder.group.api.API {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] host = devstack {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] image_compress_on_upload = True {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] image_conversion_address_space_limit = 1 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] image_conversion_cpu_limit = 60 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] image_conversion_disable = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] image_upload_use_cinder_backend = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] image_upload_use_internal_tenant = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] image_volume_cache_enabled = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] image_volume_cache_max_count = 0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] image_volume_cache_max_size_gb = 0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] init_host_max_objects_retrieval = 0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] instance_format = [instance: %(uuid)s] {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] iscsi_target_flags = {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] iscsi_write_cache = on {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] iser_helper = tgtadm {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] iser_ip_address = 192.168.122.138 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] iser_port = 3260 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] log_color = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] log_config_append = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] log_dir = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] log_file = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] log_options = True {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] log_rotate_interval = 1 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] log_rotate_interval_type = days {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] log_rotation_type = none {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] max_age = 0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] max_logfile_count = 30 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] max_logfile_size_mb = 200 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] max_over_subscription_ratio = 20.0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] message_reap_interval = 86400 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] message_ttl = 2592000 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] migration_create_volume_timeout_secs = 300 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] monkey_patch = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] monkey_patch_modules = [] {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] my_ip = 192.168.122.138 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] no_snapshot_gb_quota = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] num_iser_scan_tries = 3 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] num_shell_tries = 3 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] num_volume_device_scan_tries = 3 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] nvmeof_conn_info_version = 1 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] nvmet_ns_id = 10 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] nvmet_port_id = 1 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] osapi_max_limit = 1000 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] osapi_volume_ext_list = [] {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] osapi_volume_listen = 0.0.0.0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] osapi_volume_listen_port = 8776 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] osapi_volume_use_ssl = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] osapi_volume_workers = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] per_volume_size_limit = -1 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] periodic_fuzzy_delay = 60 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] periodic_interval = 60 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] project_id_regex = [0-9a-f\-]+ {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] public_endpoint = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] publish_errors = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] quota_backup_gigabytes = 1000 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] quota_backups = 10 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] quota_gigabytes = 1000 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] quota_groups = 10 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] quota_snapshots = 10 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] quota_volumes = 10 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] rate_limit_burst = 0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] rate_limit_except_level = CRITICAL {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] rate_limit_interval = 0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] reinit_driver_count = 3 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] replication_device = **** {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] report_discard_supported = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] report_interval = 120 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] reservation_clean_interval = 86400 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] reservation_expire = 86400 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] reserved_image_namespaces = [] {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] reserved_percentage = 0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] rpc_response_timeout = 120 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] run_external_periodic_tasks = True {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] scst_target_driver = iscsi {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] scst_target_iqn_name = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] service_down_time = 720 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] shell_completion = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] snapshot_name_template = snapshot-%s {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] snapshot_same_host = True {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] split_loggers = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] state_path = /opt/stack/data/cinder {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] storage_availability_zone = nova {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] storage_protocol = iSCSI {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] syslog_log_facility = LOG_USER {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] target_helper = lioadm {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] target_ip_address = 192.168.122.138 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] target_port = 3260 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] target_protocol = iscsi {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] target_secondary_ip_addresses = [] {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] trace_flags = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] transfer_api_class = cinder.transfer.api.API {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] transport_url = **** {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] until_refresh = 0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] use_chap_auth = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] use_default_quota_class = True {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] use_journal = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] use_json = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] use_multipath_for_image_xfer = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] use_stderr = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] use_syslog = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] verify_glance_signatures = enabled {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] volume_api_class = cinder.volume.api.API {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] volume_backend_name = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] volume_clear = zero {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] volume_clear_ionice = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] volume_clear_size = 0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] volume_copy_bps_limit = 0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] volume_dd_blocksize = 1M {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77308]: INFO cinder.volume.manager [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] volume_name_template = volume-%s {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] volume_service_inithost_offload = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] volume_usage_audit_period = month {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] zoning_mode = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_concurrency.disable_process_locking = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.auth_section = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.auth_type = password {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.auth_version = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.cache = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.certfile = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.delay_auth_decision = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.http_connect_timeout = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.include_service_catalog = True {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.insecure = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.interface = public {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.keyfile = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.memcache_password = **** {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.memcache_username = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.region_name = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.service_token_roles_required = True {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.service_type = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.token_cache_time = 300 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.138/identity {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.backend = dogpile.cache.null {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.backend_argument = **** {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.backend_expiration_time = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.config_prefix = cache.oslo {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.debug_cache_backend = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.enable_retry_client = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.enable_socket_keepalive = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.enabled = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.expiration_time = 600 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.hashclient_retry_attempts = 2 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.memcache_dead_retry = 300 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.memcache_pool_maxsize = 10 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.memcache_sasl_enabled = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.password = **** {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.proxies = [] {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.redis_db = 0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.redis_sentinel_service_name = mymaster {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.redis_server = localhost:6379 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.retry_attempts = 2 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.retry_delay = 0.0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.socket_keepalive_count = 1 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.socket_keepalive_idle = 1 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.socket_keepalive_interval = 1 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.socket_timeout = 1.0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.tls_allowed_ciphers = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.tls_cafile = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.tls_certfile = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.tls_enabled = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.tls_keyfile = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cache.username = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] coordination.backend_url = **** {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] database.asyncio_connection = **** {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] database.asyncio_slave_connection = **** {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] database.backend = sqlalchemy {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] database.connection = **** {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] database.connection_debug = 0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] database.connection_parameters = {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] database.connection_recycle_time = 3600 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] database.connection_trace = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] database.db_inc_retry_interval = True {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] database.db_max_retries = 20 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] database.db_max_retry_interval = 10 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] database.db_retry_interval = 1 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] database.max_overflow = 50 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] database.max_pool_size = 5 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] database.max_retries = 10 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] database.mysql_wsrep_sync_wait = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] database.pool_timeout = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] database.retry_interval = 10 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] database.slave_connection = **** {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] database.sqlite_synchronous = True {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] database.synchronous_reader = True {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] database.use_db_reconnect = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_tracing.insecure = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.051s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] profiler.connection_string = messaging:// {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] profiler.enabled = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] profiler.es_doc_type = notification {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] profiler.es_scroll_size = 10000 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] profiler.es_scroll_time = 2m {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] profiler.filter_error_trace = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] profiler.hmac_keys = **** {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] profiler.sentinel_service_name = mymaster {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] profiler.socket_timeout = 0.1 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] profiler.trace_requests = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] profiler.trace_sqlalchemy = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] profiler_jaeger.process_tags = {} {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] profiler_jaeger.service_name_prefix = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] profiler_otlp.service_name_prefix = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_policy.enforce_new_defaults = True {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_policy.policy_default_rule = default {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_policy.policy_file = policy.yaml {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_policy.remote_timeout = 60.0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] privsep_osbrick.group = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] privsep_osbrick.helper_command = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] privsep_osbrick.user = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cinder_sys_admin.group = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cinder_sys_admin.helper_command = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] cinder_sys_admin.user = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] service_user.auth_section = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] service_user.auth_type = password {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] service_user.cafile = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] service_user.certfile = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] service_user.collect_timing = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] service_user.insecure = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] service_user.keyfile = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] service_user.send_service_user_token = True {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] service_user.split_loggers = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] service_user.timeout = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] service_user.tls_ciphers = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] service_user.tls_min_version = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] glance.auth_section = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] glance.auth_type = password {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] glance.certfile = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] glance.collect_timing = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] glance.insecure = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] glance.keyfile = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] glance.region_name = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] glance.split_loggers = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] glance.timeout = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] glance.tls_ciphers = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] glance.tls_min_version = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.backend_availability_zone = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.chap_password = **** {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.chap_username = {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.disk_geometry = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.driver_client_cert = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.driver_client_cert_key = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.driver_data_namespace = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.driver_use_ssl = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.enable_unsupported_driver = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.extra_capabilities = {} {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.filter_function = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.goodness_function = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.iscsi_target_flags = {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.iscsi_write_cache = on {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.iser_helper = tgtadm {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.iser_ip_address = 192.168.122.138 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.iser_port = 3260 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.lvm_mirrors = 0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.lvm_share_target = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.lvm_type = auto {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.num_shell_tries = 3 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.nvmet_port_id = 1 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.replication_device = **** {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.report_discard_supported = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.reserved_percentage = 0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.scst_target_driver = iscsi {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.scst_target_iqn_name = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.storage_protocol = iSCSI {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.target_helper = tgtadm {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.target_ip_address = 192.168.122.138 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.target_port = 3260 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.target_protocol = iscsi {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.trace_flags = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.unique_fqdn_network = True {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.use_chap_auth = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.volume_backend_name = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.volume_clear = zero {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.volume_clear_ionice = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.volume_clear_size = 0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.volume_group = cinder-volumes {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_reports.file_event_handler = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_reports.log_dir = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.backend_availability_zone = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.backend_host = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.chap_password = **** {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.chap_username = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.chiscsi_conf = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.disk_geometry = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.driver_client_cert = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.driver_data_namespace = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.driver_use_ssl = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.extra_capabilities = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.filter_function = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.goodness_function = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.iser_helper = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.iser_ip_address = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.iser_port = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.iser_target_prefix = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.lvm_conf_file = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.lvm_mirrors = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.lvm_share_target = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.lvm_type = auto {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.num_shell_tries = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.nvmet_port_id = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.replication_device = **** {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.report_discard_supported = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.reserved_percentage = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.scst_target_driver = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.storage_protocol = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.target_helper = lioadm {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.target_ip_address = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.target_port = 3260 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.target_protocol = iscsi {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.trace_flags = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.078s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.use_chap_auth = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.volume_clear = zero {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.volume_clear_size = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] lvmdriver-1.volumes_dir = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.ssl = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.ssl_version = {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_notifications.driver = [] {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_notifications.retry = -1 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] oslo_messaging_notifications.transport_url = **** {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] key_manager.fixed_key = **** {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] barbican.barbican_api_version = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] barbican.barbican_endpoint = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] barbican.barbican_endpoint_type = public {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] barbican.barbican_region_name = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] barbican.cafile = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] barbican.certfile = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] barbican.collect_timing = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] barbican.insecure = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] barbican.keyfile = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] barbican.number_of_retries = 60 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] barbican.retry_delay = 1 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] barbican.send_service_user_token = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] barbican.split_loggers = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] barbican.timeout = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] barbican.tls_ciphers = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] barbican.tls_min_version = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] barbican.verify_ssl = True {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] barbican.verify_ssl_path = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] barbican_service_user.auth_section = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] barbican_service_user.auth_type = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] barbican_service_user.cafile = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] barbican_service_user.certfile = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] barbican_service_user.collect_timing = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] barbican_service_user.insecure = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] barbican_service_user.keyfile = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] barbican_service_user.split_loggers = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] barbican_service_user.timeout = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] barbican_service_user.tls_ciphers = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] barbican_service_user.tls_min_version = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] vault.approle_role_id = **** {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] vault.approle_secret_id = **** {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] vault.auth_method = approle {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] vault.auth_path = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack sudo[77315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] vault.kv_mountpoint = secret {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] vault.kv_path = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] vault.kv_version = 2 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] vault.namespace = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] vault.root_token_id = **** {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] vault.ssl_ca_crt_file = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] vault.timeout = 60.0 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] vault.token_file = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] vault.token_role = None {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] vault.use_ssl = False {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:35:41 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] ******************************************************************************** {{(pid=77156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 10 19:35:41 devstack sudo[77315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:35:41 devstack sudo[77315]: pam_unix(sudo:session): session closed for user root Sep 10 19:35:41 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.374s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:41 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:41 devstack sudo[77319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 19:35:41 devstack sudo[77319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:35:42 devstack sudo[77319]: pam_unix(sudo:session): session closed for user root Sep 10 19:35:42 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.370s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:42 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 19:35:42 devstack cinder-volume[77308]: INFO cinder.brick.local_dev.lvm [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 10 19:35:42 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:42 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:42 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:42 devstack sudo[77451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 19:35:42 devstack sudo[77451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:35:42 devstack sudo[77451]: pam_unix(sudo:session): session closed for user root Sep 10 19:35:42 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:42 devstack cinder-volume[77308]: DEBUG cinder.brick.local_dev.lvm [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77308) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 10 19:35:42 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:42 devstack sudo[77543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 19:35:42 devstack sudo[77543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:35:42 devstack sudo[77543]: pam_unix(sudo:session): session closed for user root Sep 10 19:35:42 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.496s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:42 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:42 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:42 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:43 devstack sudo[77723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 19:35:43 devstack sudo[77723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:35:43 devstack sudo[77723]: pam_unix(sudo:session): session closed for user root Sep 10 19:35:43 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:43 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:43 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:43 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:43 devstack sudo[77840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 10 19:35:43 devstack sudo[77840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:35:43 devstack sudo[77840]: pam_unix(sudo:session): session closed for user root Sep 10 19:35:43 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.295s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:43 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:43 devstack sudo[77926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 19:35:43 devstack sudo[77926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:35:43 devstack sudo[77926]: pam_unix(sudo:session): session closed for user root Sep 10 19:35:43 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:43 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:43 devstack sudo[77930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 19:35:43 devstack sudo[77930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:35:44 devstack sudo[77930]: pam_unix(sudo:session): session closed for user root Sep 10 19:35:44 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.323s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:44 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:44 devstack sudo[78013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 19:35:44 devstack sudo[78013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:35:44 devstack sudo[78013]: pam_unix(sudo:session): session closed for user root Sep 10 19:35:44 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:44 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:44 devstack sudo[78021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 19:35:44 devstack sudo[78021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:35:44 devstack sudo[78021]: pam_unix(sudo:session): session closed for user root Sep 10 19:35:44 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.340s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:44 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:44 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:44 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:44 devstack sudo[78106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 19:35:44 devstack sudo[78106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:35:45 devstack sudo[78106]: pam_unix(sudo:session): session closed for user root Sep 10 19:35:45 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.299s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:45 devstack cinder-volume[77308]: INFO cinder.volume.drivers.lvm [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 10 19:35:45 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:45 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:45 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:45 devstack sudo[78122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 19:35:45 devstack sudo[78122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:35:45 devstack sudo[78122]: pam_unix(sudo:session): session closed for user root Sep 10 19:35:45 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:45 devstack cinder-volume[77308]: DEBUG cinder.volume.drivers.lvm [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Updating volume stats {{(pid=77308) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 10 19:35:45 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:45 devstack sudo[78125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 19:35:45 devstack sudo[78125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:35:45 devstack sudo[78125]: pam_unix(sudo:session): session closed for user root Sep 10 19:35:45 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:45 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:45 devstack sudo[78128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 19:35:45 devstack sudo[78128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:35:45 devstack sudo[78128]: pam_unix(sudo:session): session closed for user root Sep 10 19:35:45 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:45 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:45 devstack sudo[78131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 19:35:45 devstack sudo[78131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:35:46 devstack sudo[78131]: pam_unix(sudo:session): session closed for user root Sep 10 19:35:46 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:46 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:46 devstack sudo[78134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 19:35:46 devstack sudo[78134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:35:46 devstack sudo[78134]: pam_unix(sudo:session): session closed for user root Sep 10 19:35:46 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:46 devstack cinder-volume[77308]: INFO cinder.volume.driver [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Driver hasn't implemented _init_vendor_properties() Sep 10 19:35:46 devstack cinder-volume[77308]: DEBUG cinder.volume.driver [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77308) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 10 19:35:46 devstack cinder-volume[77308]: DEBUG oslo_db.sqlalchemy.engines [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77308) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 19:35:46 devstack cinder-volume[77308]: DEBUG dbcounter [-] [77308] Writer thread running {{(pid=77308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 10 19:35:46 devstack cinder-volume[77308]: DEBUG cinder.db.api [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Building query based on filter {{(pid=77308) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 10 19:35:46 devstack cinder-volume[77308]: DEBUG cinder.image.image_utils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77308) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 10 19:35:46 devstack cinder-volume[77308]: INFO cinder.keymgr.migration [None req-bb25d809-b83c-421e-9606-90b39f82f8da None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 10 19:35:46 devstack cinder-volume[77308]: DEBUG cinder.volume.drivers.lvm [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Updating volume stats {{(pid=77308) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 10 19:35:46 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:46 devstack sudo[78137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 19:35:46 devstack sudo[78137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:35:46 devstack sudo[78137]: pam_unix(sudo:session): session closed for user root Sep 10 19:35:46 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:46 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:46 devstack sudo[78140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 19:35:46 devstack sudo[78140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:35:47 devstack sudo[78140]: pam_unix(sudo:session): session closed for user root Sep 10 19:35:47 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:47 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:47 devstack sudo[78145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 19:35:47 devstack sudo[78145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:35:47 devstack sudo[78145]: pam_unix(sudo:session): session closed for user root Sep 10 19:35:47 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.305s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:47 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:47 devstack sudo[78149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 19:35:47 devstack sudo[78149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:35:47 devstack sudo[78149]: pam_unix(sudo:session): session closed for user root Sep 10 19:35:47 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:47 devstack cinder-volume[77308]: DEBUG cinder.manager [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Notifying Schedulers of capabilities ... {{(pid=77308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:35:47 devstack cinder-volume[77308]: INFO cinder.volume.manager [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Driver initialization completed successfully. Sep 10 19:35:47 devstack cinder-volume[77308]: INFO cinder.manager [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Initiating service 2 cleanup Sep 10 19:35:47 devstack cinder-volume[77308]: INFO cinder.manager [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Service 2 cleanup completed. Sep 10 19:35:47 devstack cinder-volume[77308]: DEBUG cinder.service [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Creating RPC server for service cinder-volume {{(pid=77308) start /opt/stack/cinder/cinder/service.py:231}} Sep 10 19:35:47 devstack cinder-volume[77308]: DEBUG cinder.service [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77308) start /opt/stack/cinder/cinder/service.py:237}} Sep 10 19:35:47 devstack cinder-volume[77308]: INFO cinder.volume.manager [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 10 19:35:47 devstack cinder-volume[77308]: DEBUG cinder.volume.drivers.lvm [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Updating volume stats {{(pid=77308) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 10 19:35:47 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:47 devstack sudo[78152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 19:35:47 devstack sudo[78152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:35:48 devstack sudo[78152]: pam_unix(sudo:session): session closed for user root Sep 10 19:35:48 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:48 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:48 devstack sudo[78155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 19:35:48 devstack sudo[78155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:35:48 devstack sudo[78155]: pam_unix(sudo:session): session closed for user root Sep 10 19:35:48 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:48 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:48 devstack sudo[78161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 19:35:48 devstack sudo[78161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:35:48 devstack sudo[78161]: pam_unix(sudo:session): session closed for user root Sep 10 19:35:48 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:48 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:35:48 devstack sudo[78167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 19:35:48 devstack sudo[78167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:35:49 devstack sudo[78167]: pam_unix(sudo:session): session closed for user root Sep 10 19:35:49 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:35:49 devstack cinder-volume[77308]: INFO cinder.volume.manager [None req-d4cf7bd2-5aeb-4a4d-8433-c895e7f89103 None None] Driver post RPC initialization completed successfully. Sep 10 19:35:51 devstack cinder-volume[77156]: DEBUG dbcounter [-] [77156] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:35:59 devstack cinder-volume[77308]: DEBUG dbcounter [-] [77308] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:35:59 devstack cinder-volume[77308]: DEBUG dbcounter [-] [77308] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=77308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:36:08 devstack cinder-volume[77308]: DEBUG oslo_service.periodic_task [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Running periodic task VolumeManager._thread_info {{(pid=77308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:36:08 devstack cinder-volume[77308]: DEBUG cinder.volume.manager [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] thread count: 6 {{(pid=77308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 19:36:08 devstack cinder-volume[77308]: DEBUG cinder.volume.manager [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] thread info: [<_MainThread(MainThread, started 139920970678400)>, , , , , ] {{(pid=77308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 19:37:08 devstack cinder-volume[77308]: DEBUG oslo_service.periodic_task [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:37:08 devstack cinder-volume[77308]: DEBUG cinder.volume.drivers.lvm [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Updating volume stats {{(pid=77308) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 10 19:37:08 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:37:08 devstack sudo[80764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 19:37:08 devstack sudo[80764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:37:08 devstack sudo[80764]: pam_unix(sudo:session): session closed for user root Sep 10 19:37:08 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:37:08 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:37:08 devstack sudo[80794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 19:37:08 devstack sudo[80794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:37:08 devstack sudo[80794]: pam_unix(sudo:session): session closed for user root Sep 10 19:37:08 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:37:08 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:37:08 devstack sudo[80798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 19:37:08 devstack sudo[80798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:37:08 devstack sudo[80798]: pam_unix(sudo:session): session closed for user root Sep 10 19:37:08 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:37:08 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:37:08 devstack sudo[80801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 19:37:08 devstack sudo[80801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:37:09 devstack sudo[80801]: pam_unix(sudo:session): session closed for user root Sep 10 19:37:09 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:37:09 devstack cinder-volume[77308]: DEBUG cinder.manager [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Notifying Schedulers of capabilities ... {{(pid=77308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:37:09 devstack cinder-volume[77308]: DEBUG oslo_service.periodic_task [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Running periodic task VolumeManager._thread_info {{(pid=77308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:37:09 devstack cinder-volume[77308]: DEBUG cinder.volume.manager [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] thread count: 6 {{(pid=77308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 19:37:09 devstack cinder-volume[77308]: DEBUG cinder.volume.manager [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] thread info: [<_MainThread(MainThread, started 139920970678400)>, , , , , ] {{(pid=77308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 19:37:59 devstack cinder-volume[77308]: DEBUG dbcounter [-] [77308] Writing DB stats cinder:SELECT=1 {{(pid=77308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:37:59 devstack cinder-volume[77308]: DEBUG dbcounter [-] [77308] Writing DB stats cinder:UPDATE=1 {{(pid=77308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:38:08 devstack cinder-volume[77308]: DEBUG oslo_service.periodic_task [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:38:08 devstack cinder-volume[77308]: DEBUG cinder.volume.drivers.lvm [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Updating volume stats {{(pid=77308) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 10 19:38:08 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:38:08 devstack sudo[83784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 19:38:08 devstack sudo[83784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:38:08 devstack sudo[83784]: pam_unix(sudo:session): session closed for user root Sep 10 19:38:08 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:38:08 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:38:08 devstack sudo[83787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 19:38:08 devstack sudo[83787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:38:08 devstack sudo[83787]: pam_unix(sudo:session): session closed for user root Sep 10 19:38:08 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:38:08 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:38:08 devstack sudo[83791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 19:38:08 devstack sudo[83791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:38:08 devstack sudo[83791]: pam_unix(sudo:session): session closed for user root Sep 10 19:38:08 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:38:08 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:38:08 devstack sudo[83794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 19:38:08 devstack sudo[83794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:38:09 devstack sudo[83794]: pam_unix(sudo:session): session closed for user root Sep 10 19:38:09 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:38:09 devstack cinder-volume[77308]: DEBUG cinder.manager [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Notifying Schedulers of capabilities ... {{(pid=77308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:38:09 devstack cinder-volume[77308]: DEBUG oslo_service.periodic_task [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Running periodic task VolumeManager._thread_info {{(pid=77308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:38:09 devstack cinder-volume[77308]: DEBUG cinder.volume.manager [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] thread count: 6 {{(pid=77308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 19:38:09 devstack cinder-volume[77308]: DEBUG cinder.volume.manager [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] thread info: [<_MainThread(MainThread, started 139920970678400)>, , , , , ] {{(pid=77308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 19:39:08 devstack cinder-volume[77308]: DEBUG oslo_service.periodic_task [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:39:08 devstack cinder-volume[77308]: DEBUG cinder.volume.drivers.lvm [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Updating volume stats {{(pid=77308) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 10 19:39:08 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:39:08 devstack sudo[85818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 19:39:08 devstack sudo[85818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:39:08 devstack sudo[85818]: pam_unix(sudo:session): session closed for user root Sep 10 19:39:08 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:39:08 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:39:08 devstack sudo[85832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 19:39:08 devstack sudo[85832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:39:08 devstack sudo[85832]: pam_unix(sudo:session): session closed for user root Sep 10 19:39:08 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:39:08 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:39:08 devstack sudo[85845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 19:39:08 devstack sudo[85845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:39:08 devstack sudo[85845]: pam_unix(sudo:session): session closed for user root Sep 10 19:39:08 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:39:08 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:39:08 devstack sudo[85868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 19:39:08 devstack sudo[85868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:39:09 devstack sudo[85868]: pam_unix(sudo:session): session closed for user root Sep 10 19:39:09 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:39:09 devstack cinder-volume[77308]: DEBUG cinder.manager [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Notifying Schedulers of capabilities ... {{(pid=77308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:39:59 devstack cinder-volume[77308]: DEBUG dbcounter [-] [77308] Writing DB stats cinder:SELECT=1 {{(pid=77308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:39:59 devstack cinder-volume[77308]: DEBUG dbcounter [-] [77308] Writing DB stats cinder:UPDATE=1 {{(pid=77308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:40:08 devstack cinder-volume[77308]: DEBUG oslo_service.periodic_task [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:40:08 devstack cinder-volume[77308]: DEBUG cinder.volume.drivers.lvm [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Updating volume stats {{(pid=77308) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 10 19:40:08 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:40:08 devstack sudo[86936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 19:40:08 devstack sudo[86936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:40:08 devstack sudo[86936]: pam_unix(sudo:session): session closed for user root Sep 10 19:40:08 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:40:08 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:40:08 devstack sudo[86944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 19:40:08 devstack sudo[86944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:40:08 devstack sudo[86944]: pam_unix(sudo:session): session closed for user root Sep 10 19:40:08 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:40:08 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:40:08 devstack sudo[86949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 19:40:08 devstack sudo[86949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:40:08 devstack sudo[86949]: pam_unix(sudo:session): session closed for user root Sep 10 19:40:08 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:40:08 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:40:08 devstack sudo[86954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 19:40:08 devstack sudo[86954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:40:09 devstack sudo[86954]: pam_unix(sudo:session): session closed for user root Sep 10 19:40:09 devstack cinder-volume[77308]: DEBUG oslo_concurrency.processutils [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=77308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:40:09 devstack cinder-volume[77308]: DEBUG cinder.manager [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Notifying Schedulers of capabilities ... {{(pid=77308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:40:09 devstack cinder-volume[77308]: DEBUG oslo_service.periodic_task [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] Running periodic task VolumeManager._thread_info {{(pid=77308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:40:09 devstack cinder-volume[77308]: DEBUG cinder.volume.manager [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] thread count: 6 {{(pid=77308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 19:40:09 devstack cinder-volume[77308]: DEBUG cinder.volume.manager [None req-576a0963-b18f-4630-821a-7a6dc2271673 None None] thread info: [<_MainThread(MainThread, started 139920970678400)>, , , , , ] {{(pid=77308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 19:40:18 devstack cinder-volume[77156]: INFO oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] Caught SIGTERM, stopping children Sep 10 19:40:18 devstack cinder-volume[77156]: DEBUG oslo_concurrency.lockutils [None req-11223291-6456-4f17-9989-f94971308a48 None None] Acquiring lock "singleton_lock" {{(pid=77156) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 10 19:40:18 devstack cinder-volume[77156]: DEBUG oslo_concurrency.lockutils [None req-11223291-6456-4f17-9989-f94971308a48 None None] Acquired lock "singleton_lock" {{(pid=77156) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 10 19:40:18 devstack cinder-volume[77156]: DEBUG oslo_concurrency.lockutils [None req-11223291-6456-4f17-9989-f94971308a48 None None] Releasing lock "singleton_lock" {{(pid=77156) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 10 19:40:18 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] Stop services. {{(pid=77156) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 10 19:40:18 devstack cinder-volume[77156]: DEBUG oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] Killing children. {{(pid=77156) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 10 19:40:18 devstack cinder-volume[77156]: INFO oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] Waiting on 1 children to exit Sep 10 19:40:22 devstack cinder-volume[77308]: DEBUG oslo_concurrency.lockutils [None req-11223291-6456-4f17-9989-f94971308a48 None None] Acquiring lock "singleton_lock" {{(pid=77308) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 10 19:40:22 devstack cinder-volume[77308]: DEBUG oslo_concurrency.lockutils [None req-11223291-6456-4f17-9989-f94971308a48 None None] Acquired lock "singleton_lock" {{(pid=77308) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 10 19:40:22 devstack cinder-volume[77308]: DEBUG oslo_concurrency.lockutils [None req-11223291-6456-4f17-9989-f94971308a48 None None] Releasing lock "singleton_lock" {{(pid=77308) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 10 19:40:22 devstack cinder-volume[77308]: WARNING amqp [None req-11223291-6456-4f17-9989-f94971308a48 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 10 19:40:22 devstack cinder-volume[77308]: WARNING amqp [None req-11223291-6456-4f17-9989-f94971308a48 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 10 19:40:22 devstack cinder-volume[77156]: INFO oslo_service.backend._eventlet.service [None req-11223291-6456-4f17-9989-f94971308a48 None None] Child 77308 exited with status 0 Sep 10 19:40:23 devstack cinder-volume[87345]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 10 19:40:23 devstack cinder-volume[87345]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 10 19:40:23 devstack cinder-volume[87345]: we strongly recommend against using it for new projects. Sep 10 19:40:23 devstack cinder-volume[87345]: If you are already using Eventlet, we recommend migrating to a different Sep 10 19:40:23 devstack cinder-volume[87345]: framework. For more detail see Sep 10 19:40:23 devstack cinder-volume[87345]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 10 19:40:23 devstack cinder-volume[87345]: import eventlet # noqa Sep 10 19:40:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87345) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 10 19:40:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87345) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 10 19:40:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87345) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 10 19:40:25 devstack cinder-volume[87345]: INFO dbcounter [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] Registered counter for database cinder Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_db.sqlalchemy.engines [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87345) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writer thread running {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 10 19:40:26 devstack cinder-volume[87345]: INFO cinder.rpc [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 10 19:40:26 devstack cinder-volume[87345]: INFO cinder.rpc [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_db.sqlalchemy.engines [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87345) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 19:40:26 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] Determined volume DB was empty at startup. Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87345) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 10 19:40:26 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 10 19:40:26 devstack cinder-volume[87345]: WARNING stevedore.named [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 10 19:40:26 devstack cinder-volume[87345]: WARNING castellan.key_manager [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 19:40:26 devstack cinder-volume[87345]: WARNING cinder.keymgr.conf_key_mgr [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 19:40:26 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_db.sqlalchemy.engines [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87345) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 19:40:26 devstack cinder-volume[87345]: INFO oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] Starting 1 workers Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] Started child 87502 {{(pid=87345) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] Full set of CONF: {{(pid=87345) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] ******************************************************************************** {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] Configuration options gathered from: {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] ================================================================================ {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] allow_availability_zone_fallback = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] allow_compression_on_image_upload = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] allowed_direct_url_schemes = [] {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] api_rate_limit = True {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] auth_strategy = keystone {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_availability_zone = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_host = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_name = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_stats_polling_interval = 60 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backup_api_class = cinder.backup.api.API {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backup_name_template = backup-%s {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backup_use_same_host = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backup_use_temp_snapshot = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] chap_password = **** {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] chap_username = {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cinder_internal_tenant_project_id = 7dacb7776a5b4ac794cc42e21588c999 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cinder_internal_tenant_user_id = 928ad658bcf14f8bb4ded8228bf462c0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cluster = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] compression_format = gzip {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] compute_api_class = cinder.compute.nova.API {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] config_dir = [] {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87502]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] config_source = [] {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] control_exchange = openstack {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] debug = True {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] default_availability_zone = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] default_group_type = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] default_volume_type = QuobyteHD {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] disk_geometry = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] driver_client_cert = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] driver_client_cert_key = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] driver_data_namespace = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] driver_ssl_cert_path = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] driver_ssl_cert_verify = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] driver_use_ssl = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] enable_new_services = True {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] enable_unsupported_driver = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] enabled_backends = ['QuobyteHD'] {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] enforce_multipath_for_image_xfer = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] filter_function = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] glance_api_insecure = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] glance_api_servers = ['http://192.168.122.138/image'] {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] glance_api_ssl_compression = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] glance_ca_certificates_file = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] glance_catalog_info = image:glance:publicURL {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] glance_certfile = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] glance_keyfile = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] glance_num_retries = 3 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] glance_request_timeout = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] goodness_function = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] graceful_shutdown_timeout = 5 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] group_api_class = cinder.group.api.API {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] host = devstack {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] image_compress_on_upload = True {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] image_conversion_address_space_limit = 1 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] image_conversion_cpu_limit = 60 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] image_conversion_disable = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] image_upload_use_cinder_backend = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] image_upload_use_internal_tenant = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] image_volume_cache_enabled = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] image_volume_cache_max_count = 0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] image_volume_cache_max_size_gb = 0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] init_host_max_objects_retrieval = 0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] instance_format = [instance: %(uuid)s] {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] iscsi_target_flags = {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] iscsi_write_cache = on {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] iser_helper = tgtadm {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] iser_ip_address = 192.168.122.138 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] iser_port = 3260 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] log_color = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] log_config_append = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] log_dir = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] log_file = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] log_options = True {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] log_rotate_interval = 1 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] log_rotate_interval_type = days {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] log_rotation_type = none {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] max_age = 0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] max_logfile_count = 30 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] max_logfile_size_mb = 200 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] max_over_subscription_ratio = 20.0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] message_reap_interval = 86400 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] message_ttl = 2592000 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] migration_create_volume_timeout_secs = 300 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] monkey_patch = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] monkey_patch_modules = [] {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] my_ip = 192.168.122.138 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] no_snapshot_gb_quota = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] num_iser_scan_tries = 3 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] num_shell_tries = 3 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] num_volume_device_scan_tries = 3 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] nvmeof_conn_info_version = 1 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] nvmet_ns_id = 10 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] nvmet_port_id = 1 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] osapi_max_limit = 1000 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] osapi_volume_ext_list = [] {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] osapi_volume_listen_port = 8776 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] osapi_volume_use_ssl = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] osapi_volume_workers = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] per_volume_size_limit = -1 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] periodic_fuzzy_delay = 60 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] periodic_interval = 60 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] public_endpoint = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] publish_errors = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] quota_backup_gigabytes = 1000 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] quota_backups = 10 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] quota_gigabytes = 1000 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] quota_groups = 10 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] quota_snapshots = 10 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] quota_volumes = 10 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] rate_limit_burst = 0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] rate_limit_except_level = CRITICAL {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] rate_limit_interval = 0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] reinit_driver_count = 3 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] replication_device = **** {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] report_discard_supported = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] report_interval = 120 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] reservation_clean_interval = 86400 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] reservation_expire = 86400 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] reserved_image_namespaces = [] {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] reserved_percentage = 0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] rpc_response_timeout = 120 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] run_external_periodic_tasks = True {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] scst_target_driver = iscsi {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] scst_target_iqn_name = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] service_down_time = 720 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] shell_completion = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] snapshot_name_template = snapshot-%s {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] split_loggers = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] state_path = /opt/stack/data/cinder {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] storage_availability_zone = nova {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] storage_protocol = iSCSI {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87502]: INFO cinder.volume.manager [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Starting volume driver QuobyteDriver (1.2.1) Sep 10 19:40:26 devstack cinder-volume[87502]: DEBUG cinder.volume.drivers.remotefs [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87502) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] syslog_log_facility = LOG_USER {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] target_helper = lioadm {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] target_ip_address = 192.168.122.138 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] target_port = 3260 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] target_protocol = iscsi {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] target_secondary_ip_addresses = [] {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] trace_flags = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] transport_url = **** {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] until_refresh = 0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] use_chap_auth = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] use_default_quota_class = True {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] use_journal = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] use_json = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] use_multipath_for_image_xfer = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] use_stderr = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] use_syslog = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] verify_glance_signatures = enabled {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] volume_api_class = cinder.volume.api.API {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] volume_backend_name = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] volume_clear = zero {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] volume_clear_ionice = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] volume_clear_size = 0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] volume_copy_bps_limit = 0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] volume_dd_blocksize = 1M {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] volume_name_template = volume-%s {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] volume_service_inithost_offload = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] volume_usage_audit_period = month {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] zoning_mode = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_concurrency.disable_process_locking = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.auth_section = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.auth_type = password {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.auth_version = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.cache = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.certfile = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.include_service_catalog = True {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.insecure = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.interface = public {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.keyfile = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.memcache_password = **** {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.memcache_username = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.region_name = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.service_type = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.138/identity {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.backend = dogpile.cache.null {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.backend_argument = **** {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.backend_expiration_time = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.config_prefix = cache.oslo {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.debug_cache_backend = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.enable_retry_client = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.enable_socket_keepalive = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.enabled = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.expiration_time = 600 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.hashclient_retry_attempts = 2 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.memcache_dead_retry = 300 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.memcache_pool_maxsize = 10 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.memcache_sasl_enabled = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.password = **** {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.proxies = [] {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.redis_db = 0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.redis_server = localhost:6379 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.retry_attempts = 2 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.retry_delay = 0.0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.socket_keepalive_count = 1 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.socket_keepalive_idle = 1 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.socket_keepalive_interval = 1 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.socket_timeout = 1.0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.tls_allowed_ciphers = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.tls_cafile = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.tls_certfile = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.tls_enabled = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.tls_keyfile = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cache.username = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] coordination.backend_url = **** {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] database.asyncio_connection = **** {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] database.asyncio_slave_connection = **** {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] database.backend = sqlalchemy {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] database.connection = **** {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] database.connection_debug = 0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] database.connection_parameters = {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] database.connection_recycle_time = 3600 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] database.connection_trace = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] database.db_inc_retry_interval = True {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] database.db_max_retries = 20 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] database.db_max_retry_interval = 10 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] database.db_retry_interval = 1 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] database.max_overflow = 50 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] database.max_pool_size = 5 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] database.max_retries = 10 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] database.mysql_wsrep_sync_wait = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87502]: DEBUG cinder.volume.drivers.quobyte [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87502) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] database.pool_timeout = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] database.retry_interval = 10 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] database.slave_connection = **** {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] database.sqlite_synchronous = True {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] database.synchronous_reader = True {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] database.use_db_reconnect = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87502]: WARNING cinder.volume.drivers.quobyte [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87502]: WARNING cinder.volume.drivers.quobyte [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_tracing.insecure = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87502]: DEBUG oslo_concurrency.processutils [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Running cmd (subprocess): mount.quobyte {{(pid=87502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] profiler.connection_string = messaging:// {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] profiler.enabled = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] profiler.es_doc_type = notification {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] profiler.es_scroll_size = 10000 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] profiler.es_scroll_time = 2m {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] profiler.filter_error_trace = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] profiler.hmac_keys = **** {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] profiler.sentinel_service_name = mymaster {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] profiler.socket_timeout = 0.1 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] profiler.trace_requests = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] profiler.trace_sqlalchemy = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] profiler_jaeger.process_tags = {} {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] profiler_jaeger.service_name_prefix = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] profiler_otlp.service_name_prefix = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_policy.enforce_new_defaults = True {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_policy.policy_default_rule = default {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_policy.policy_file = policy.yaml {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] privsep_osbrick.group = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] privsep_osbrick.helper_command = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] privsep_osbrick.user = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cinder_sys_admin.group = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cinder_sys_admin.helper_command = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] cinder_sys_admin.user = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] service_user.auth_section = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] service_user.auth_type = password {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] service_user.cafile = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] service_user.certfile = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] service_user.collect_timing = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] service_user.insecure = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] service_user.keyfile = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] service_user.send_service_user_token = True {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] service_user.split_loggers = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] service_user.timeout = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] service_user.tls_ciphers = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] service_user.tls_min_version = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] glance.auth_section = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] glance.auth_type = password {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] glance.certfile = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] glance.collect_timing = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] glance.insecure = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] glance.keyfile = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] glance.region_name = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] glance.split_loggers = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] glance.timeout = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] glance.tls_ciphers = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] glance.tls_min_version = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.backend_availability_zone = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.chap_password = **** {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.chap_username = {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.disk_geometry = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.driver_client_cert = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.driver_client_cert_key = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.driver_data_namespace = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.driver_use_ssl = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.extra_capabilities = {} {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.filter_function = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.goodness_function = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.iscsi_target_flags = {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.iscsi_write_cache = on {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.iser_helper = tgtadm {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.iser_ip_address = 192.168.122.138 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.iser_port = 3260 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.nas_host = {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.nas_login = admin {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.nas_mount_options = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.nas_password = **** {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.nas_private_key = {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.nas_share_path = {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.num_shell_tries = 3 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.quobyte_volume_url = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.replication_device = **** {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.report_discard_supported = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.reserved_percentage = 0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.target_helper = tgtadm {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.target_ip_address = 192.168.122.138 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.target_port = 3260 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.target_protocol = iscsi {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.trace_flags = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.unique_fqdn_network = True {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.use_chap_auth = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.volume_backend_name = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.volume_clear = zero {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.volume_clear_ionice = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.volume_clear_size = 0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_reports.file_event_handler = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_reports.log_dir = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.backend_availability_zone = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.backend_host = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.chap_password = **** {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.chap_username = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.chiscsi_conf = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.disk_geometry = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.driver_client_cert = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.driver_data_namespace = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.driver_use_ssl = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.extra_capabilities = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.filter_function = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.goodness_function = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.iser_helper = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.iser_ip_address = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.iser_port = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.iser_target_prefix = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.nas_host = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.nas_login = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.nas_mount_options = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.nas_password = **** {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.nas_private_key = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.nas_share_path = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.nas_ssh_port = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.num_shell_tries = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.nvmet_port_id = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.replication_device = **** {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.report_discard_supported = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.reserved_percentage = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.scst_target_driver = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.storage_protocol = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.target_helper = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.target_ip_address = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.target_port = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.target_prefix = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.target_protocol = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.trace_flags = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.use_chap_auth = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.volume_clear = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.volume_clear_size = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] QuobyteHD.volumes_dir = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.ssl = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_notifications.driver = [] {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_notifications.retry = -1 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] key_manager.fixed_key = **** {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] barbican.barbican_api_version = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] barbican.barbican_endpoint = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] barbican.barbican_endpoint_type = public {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] barbican.barbican_region_name = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] barbican.cafile = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] barbican.certfile = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] barbican.collect_timing = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] barbican.insecure = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] barbican.keyfile = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] barbican.number_of_retries = 60 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] barbican.retry_delay = 1 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] barbican.send_service_user_token = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] barbican.split_loggers = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] barbican.timeout = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] barbican.tls_ciphers = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] barbican.tls_min_version = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] barbican.verify_ssl = True {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] barbican.verify_ssl_path = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] barbican_service_user.auth_section = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] barbican_service_user.auth_type = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] barbican_service_user.cafile = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] barbican_service_user.certfile = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] barbican_service_user.collect_timing = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] barbican_service_user.insecure = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] barbican_service_user.keyfile = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] barbican_service_user.split_loggers = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] barbican_service_user.timeout = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] barbican_service_user.tls_ciphers = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] barbican_service_user.tls_min_version = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] vault.approle_role_id = **** {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] vault.approle_secret_id = **** {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] vault.auth_method = approle {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] vault.auth_path = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] vault.kv_mountpoint = secret {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] vault.kv_path = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] vault.kv_version = 2 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] vault.namespace = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] vault.root_token_id = **** {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] vault.ssl_ca_crt_file = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] vault.timeout = 60.0 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] vault.token_file = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] vault.token_role = None {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] vault.use_ssl = False {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:26 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] ******************************************************************************** {{(pid=87345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 10 19:40:26 devstack quobyte-client[87519]: Reading configuration file: /etc/quobyte/client.cfg Sep 10 19:40:26 devstack quobyte-client[87519]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 10 19:40:26 devstack cinder-volume[87502]: DEBUG oslo_concurrency.processutils [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] CMD "mount.quobyte" returned: 1 in 0.150s {{(pid=87502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:40:26 devstack cinder-volume[87502]: DEBUG oslo_concurrency.lockutils [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87502) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:40:26 devstack cinder-volume[87502]: DEBUG oslo_concurrency.lockutils [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87502) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:40:26 devstack cinder-volume[87502]: DEBUG cinder.volume.drivers.quobyte [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=87502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:40:26 devstack cinder-volume[87502]: INFO cinder.volume.drivers.quobyte [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 ... Sep 10 19:40:26 devstack cinder-volume[87502]: DEBUG oslo_concurrency.processutils [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 -c /etc/quobyte/client-cinder.cfg {{(pid=87502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:40:27 devstack sudo[87529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 -c /etc/quobyte/client-cinder.cfg Sep 10 19:40:27 devstack sudo[87529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:40:27 devstack sudo[87529]: pam_unix(sudo:session): session closed for user root Sep 10 19:40:27 devstack cinder-volume[87502]: DEBUG oslo_concurrency.processutils [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.547s {{(pid=87502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:40:27 devstack cinder-volume[87502]: INFO cinder.volume.drivers.quobyte [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 succeeded Sep 10 19:40:27 devstack cinder-volume[87502]: DEBUG cinder.volume.drivers.quobyte [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=87502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:40:27 devstack cinder-volume[87502]: DEBUG oslo_concurrency.lockutils [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.580s {{(pid=87502) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:40:27 devstack cinder-volume[87502]: DEBUG oslo_concurrency.processutils [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=87502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:40:27 devstack sudo[87606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:40:27 devstack sudo[87606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:40:27 devstack sudo[87606]: pam_unix(sudo:session): session closed for user root Sep 10 19:40:27 devstack cinder-volume[87502]: DEBUG oslo_concurrency.processutils [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.423s {{(pid=87502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:40:27 devstack cinder-volume[87502]: INFO cinder.volume.driver [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Driver hasn't implemented _init_vendor_properties() Sep 10 19:40:27 devstack cinder-volume[87502]: DEBUG cinder.volume.driver [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.2748527526855, 'free_capacity_gb': 1773.2748527526855, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87502) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 10 19:40:28 devstack cinder-volume[87502]: DEBUG oslo_db.sqlalchemy.engines [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87502) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 19:40:28 devstack cinder-volume[87502]: DEBUG dbcounter [-] [87502] Writer thread running {{(pid=87502) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 10 19:40:28 devstack cinder-volume[87502]: DEBUG cinder.db.api [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Building query based on filter {{(pid=87502) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 10 19:40:28 devstack cinder-volume[87502]: DEBUG cinder.image.image_utils [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87502) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 10 19:40:28 devstack cinder-volume[87502]: INFO cinder.keymgr.migration [None req-d76680cd-ce40-459c-a2d0-2275d48a1e92 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 10 19:40:28 devstack cinder-volume[87502]: DEBUG oslo_concurrency.lockutils [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87502) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:40:28 devstack cinder-volume[87502]: DEBUG oslo_concurrency.lockutils [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87502) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:40:28 devstack cinder-volume[87502]: DEBUG cinder.volume.drivers.quobyte [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=87502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:40:28 devstack cinder-volume[87502]: DEBUG cinder.volume.drivers.quobyte [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=87502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:40:28 devstack cinder-volume[87502]: DEBUG oslo_concurrency.lockutils [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87502) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:40:28 devstack cinder-volume[87502]: DEBUG oslo_concurrency.processutils [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=87502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:40:28 devstack sudo[87688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:40:28 devstack sudo[87688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:40:28 devstack sudo[87688]: pam_unix(sudo:session): session closed for user root Sep 10 19:40:28 devstack cinder-volume[87502]: DEBUG oslo_concurrency.processutils [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.259s {{(pid=87502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:40:28 devstack cinder-volume[87502]: DEBUG cinder.manager [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Notifying Schedulers of capabilities ... {{(pid=87502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:40:28 devstack cinder-volume[87502]: INFO cinder.volume.manager [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Driver initialization completed successfully. Sep 10 19:40:28 devstack cinder-volume[87502]: INFO cinder.manager [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Initiating service 3 cleanup Sep 10 19:40:28 devstack cinder-volume[87502]: INFO cinder.manager [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Service 3 cleanup completed. Sep 10 19:40:28 devstack cinder-volume[87502]: DEBUG cinder.service [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Creating RPC server for service cinder-volume {{(pid=87502) start /opt/stack/cinder/cinder/service.py:231}} Sep 10 19:40:28 devstack cinder-volume[87502]: DEBUG cinder.service [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87502) start /opt/stack/cinder/cinder/service.py:237}} Sep 10 19:40:28 devstack cinder-volume[87502]: INFO cinder.volume.manager [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 10 19:40:28 devstack cinder-volume[87502]: DEBUG oslo_concurrency.lockutils [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87502) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:40:28 devstack cinder-volume[87502]: DEBUG oslo_concurrency.lockutils [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87502) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:40:28 devstack cinder-volume[87502]: DEBUG cinder.volume.drivers.quobyte [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=87502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:40:28 devstack cinder-volume[87502]: DEBUG cinder.volume.drivers.quobyte [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=87502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:40:28 devstack cinder-volume[87502]: DEBUG oslo_concurrency.lockutils [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87502) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:40:28 devstack cinder-volume[87502]: DEBUG oslo_concurrency.processutils [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=87502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:40:28 devstack sudo[87704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:40:28 devstack sudo[87704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:40:28 devstack sudo[87704]: pam_unix(sudo:session): session closed for user root Sep 10 19:40:28 devstack cinder-volume[87502]: DEBUG oslo_concurrency.processutils [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.346s {{(pid=87502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:40:28 devstack cinder-volume[87502]: INFO cinder.volume.manager [None req-d1adb504-4555-4b89-8d4c-49a310815b0b None None] Driver post RPC initialization completed successfully. Sep 10 19:40:33 devstack cinder-volume[87345]: INFO oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] Caught SIGTERM, stopping children Sep 10 19:40:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] Acquiring lock "singleton_lock" {{(pid=87345) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 10 19:40:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] Acquired lock "singleton_lock" {{(pid=87345) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 10 19:40:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] Releasing lock "singleton_lock" {{(pid=87345) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 10 19:40:33 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] Stop services. {{(pid=87345) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 10 19:40:33 devstack cinder-volume[87345]: DEBUG oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] Killing children. {{(pid=87345) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 10 19:40:33 devstack cinder-volume[87345]: INFO oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] Waiting on 1 children to exit Sep 10 19:40:36 devstack cinder-volume[87502]: DEBUG oslo_concurrency.lockutils [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] Acquiring lock "singleton_lock" {{(pid=87502) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 10 19:40:36 devstack cinder-volume[87502]: DEBUG oslo_concurrency.lockutils [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] Acquired lock "singleton_lock" {{(pid=87502) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 10 19:40:36 devstack cinder-volume[87502]: DEBUG oslo_concurrency.lockutils [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] Releasing lock "singleton_lock" {{(pid=87502) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 10 19:40:36 devstack cinder-volume[87502]: WARNING amqp [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 10 19:40:36 devstack cinder-volume[87502]: WARNING amqp [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 10 19:40:36 devstack cinder-volume[87345]: INFO oslo_service.backend._eventlet.service [None req-5400c854-96b7-4610-836e-5ffdd882e140 None None] Child 87502 exited with status 0 Sep 10 19:40:37 devstack cinder-volume[88034]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 10 19:40:37 devstack cinder-volume[88034]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 10 19:40:37 devstack cinder-volume[88034]: we strongly recommend against using it for new projects. Sep 10 19:40:37 devstack cinder-volume[88034]: If you are already using Eventlet, we recommend migrating to a different Sep 10 19:40:37 devstack cinder-volume[88034]: framework. For more detail see Sep 10 19:40:37 devstack cinder-volume[88034]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 10 19:40:37 devstack cinder-volume[88034]: import eventlet # noqa Sep 10 19:40:39 devstack cinder-volume[88034]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88034) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 10 19:40:39 devstack cinder-volume[88034]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88034) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 10 19:40:39 devstack cinder-volume[88034]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88034) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 10 19:40:40 devstack cinder-volume[88034]: INFO dbcounter [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] Registered counter for database cinder Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_db.sqlalchemy.engines [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88034) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG dbcounter [-] [88034] Writer thread running {{(pid=88034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 10 19:40:40 devstack cinder-volume[88034]: INFO cinder.rpc [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 10 19:40:40 devstack cinder-volume[88034]: INFO cinder.rpc [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_db.sqlalchemy.engines [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88034) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 19:40:40 devstack cinder-volume[88034]: INFO cinder.volume.manager [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] Determined volume DB was empty at startup. Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG cinder.volume.manager [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88034) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 10 19:40:40 devstack cinder-volume[88034]: WARNING stevedore.named [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 10 19:40:40 devstack cinder-volume[88034]: WARNING castellan.key_manager [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 19:40:40 devstack cinder-volume[88034]: WARNING cinder.keymgr.conf_key_mgr [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 19:40:40 devstack cinder-volume[88034]: INFO cinder.volume.manager [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_db.sqlalchemy.engines [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88034) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 19:40:40 devstack cinder-volume[88034]: INFO oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] Starting 1 workers Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] Started child 88093 {{(pid=88034) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] Full set of CONF: {{(pid=88034) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] ******************************************************************************** {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] Configuration options gathered from: {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] ================================================================================ {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 10 19:40:40 devstack cinder-volume[88093]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] allow_availability_zone_fallback = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] allow_compression_on_image_upload = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] allowed_direct_url_schemes = [] {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] api_rate_limit = True {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] auth_strategy = keystone {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_availability_zone = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_host = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_name = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_stats_polling_interval = 60 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backup_api_class = cinder.backup.api.API {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backup_name_template = backup-%s {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backup_use_same_host = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backup_use_temp_snapshot = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] chap_password = **** {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] chap_username = {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cinder_internal_tenant_project_id = 7dacb7776a5b4ac794cc42e21588c999 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cinder_internal_tenant_user_id = 928ad658bcf14f8bb4ded8228bf462c0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cluster = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] compression_format = gzip {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] compute_api_class = cinder.compute.nova.API {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] config_dir = [] {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] config_source = [] {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] control_exchange = openstack {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] debug = True {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] default_availability_zone = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] default_group_type = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] default_volume_type = QuobyteHD {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] disk_geometry = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] driver_client_cert = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] driver_client_cert_key = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] driver_data_namespace = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] driver_ssl_cert_path = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] driver_ssl_cert_verify = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] driver_use_ssl = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] enable_new_services = True {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] enable_unsupported_driver = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] enabled_backends = ['QuobyteHD'] {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] enforce_multipath_for_image_xfer = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] filter_function = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] glance_api_insecure = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] glance_api_servers = ['http://192.168.122.138/image'] {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] glance_api_ssl_compression = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] glance_ca_certificates_file = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] glance_catalog_info = image:glance:publicURL {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] glance_certfile = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] glance_keyfile = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] glance_num_retries = 3 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] glance_request_timeout = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] goodness_function = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] graceful_shutdown_timeout = 5 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] group_api_class = cinder.group.api.API {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] host = devstack {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] image_compress_on_upload = True {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] image_conversion_address_space_limit = 1 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] image_conversion_cpu_limit = 60 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] image_conversion_disable = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] image_upload_use_cinder_backend = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] image_upload_use_internal_tenant = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] image_volume_cache_enabled = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] image_volume_cache_max_count = 0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] image_volume_cache_max_size_gb = 0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] init_host_max_objects_retrieval = 0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] instance_format = [instance: %(uuid)s] {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] iscsi_target_flags = {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] iscsi_write_cache = on {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] iser_helper = tgtadm {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] iser_ip_address = 192.168.122.138 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] iser_port = 3260 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Starting volume driver QuobyteDriver (1.2.1) Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] log_color = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88093) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] log_config_append = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] log_dir = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] log_file = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] log_options = True {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] log_rotate_interval = 1 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] log_rotate_interval_type = days {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] log_rotation_type = none {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] max_age = 0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] max_logfile_count = 30 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] max_logfile_size_mb = 200 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] max_over_subscription_ratio = 20.0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] message_reap_interval = 86400 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] message_ttl = 2592000 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] migration_create_volume_timeout_secs = 300 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] monkey_patch = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] monkey_patch_modules = [] {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] my_ip = 192.168.122.138 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] no_snapshot_gb_quota = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] num_iser_scan_tries = 3 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] num_shell_tries = 3 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] num_volume_device_scan_tries = 3 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] nvmeof_conn_info_version = 1 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] nvmet_ns_id = 10 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] nvmet_port_id = 1 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] osapi_max_limit = 1000 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] osapi_volume_ext_list = [] {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] osapi_volume_listen_port = 8776 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] osapi_volume_use_ssl = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] osapi_volume_workers = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] per_volume_size_limit = -1 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] periodic_fuzzy_delay = 60 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] periodic_interval = 60 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] public_endpoint = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] publish_errors = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] quota_backup_gigabytes = 1000 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] quota_backups = 10 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] quota_gigabytes = 1000 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] quota_groups = 10 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] quota_snapshots = 10 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] quota_volumes = 10 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] rate_limit_burst = 0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] rate_limit_except_level = CRITICAL {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] rate_limit_interval = 0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] reinit_driver_count = 3 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] replication_device = **** {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] report_discard_supported = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] report_interval = 120 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] reservation_clean_interval = 86400 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] reservation_expire = 86400 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] reserved_image_namespaces = [] {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] reserved_percentage = 0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] rpc_response_timeout = 120 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] run_external_periodic_tasks = True {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] scst_target_driver = iscsi {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] scst_target_iqn_name = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] service_down_time = 720 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] shell_completion = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] snapshot_name_template = snapshot-%s {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] split_loggers = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] state_path = /opt/stack/data/cinder {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] storage_availability_zone = nova {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] storage_protocol = iSCSI {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] syslog_log_facility = LOG_USER {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] target_helper = lioadm {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] target_ip_address = 192.168.122.138 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] target_port = 3260 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] target_protocol = iscsi {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] target_secondary_ip_addresses = [] {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] trace_flags = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] transport_url = **** {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] until_refresh = 0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] use_chap_auth = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] use_default_quota_class = True {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] use_journal = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] use_json = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] use_multipath_for_image_xfer = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] use_stderr = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] use_syslog = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] verify_glance_signatures = enabled {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] volume_api_class = cinder.volume.api.API {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] volume_backend_name = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] volume_clear = zero {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] volume_clear_ionice = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] volume_clear_size = 0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] volume_copy_bps_limit = 0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] volume_dd_blocksize = 1M {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] volume_name_template = volume-%s {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] volume_service_inithost_offload = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] volume_usage_audit_period = month {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] zoning_mode = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_concurrency.disable_process_locking = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.auth_section = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.auth_type = password {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.auth_version = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.cache = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.certfile = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.include_service_catalog = True {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.insecure = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.interface = public {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.keyfile = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.memcache_password = **** {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88093) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.quobyte [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 10 19:40:40 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.quobyte [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.memcache_username = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Running cmd (subprocess): mount.quobyte {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.region_name = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.service_type = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.138/identity {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.backend = dogpile.cache.null {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.backend_argument = **** {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.backend_expiration_time = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.config_prefix = cache.oslo {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.debug_cache_backend = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.enable_retry_client = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.enable_socket_keepalive = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.enabled = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.expiration_time = 600 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.hashclient_retry_attempts = 2 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.memcache_dead_retry = 300 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.memcache_pool_maxsize = 10 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.memcache_sasl_enabled = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.password = **** {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.proxies = [] {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.redis_db = 0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.redis_server = localhost:6379 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.retry_attempts = 2 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.retry_delay = 0.0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.socket_keepalive_count = 1 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.socket_keepalive_idle = 1 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.socket_keepalive_interval = 1 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.socket_timeout = 1.0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.tls_allowed_ciphers = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.tls_cafile = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.tls_certfile = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.tls_enabled = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.tls_keyfile = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cache.username = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] coordination.backend_url = **** {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] database.asyncio_connection = **** {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] database.asyncio_slave_connection = **** {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] database.backend = sqlalchemy {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] database.connection = **** {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] database.connection_debug = 0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] database.connection_parameters = {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] database.connection_recycle_time = 3600 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] database.connection_trace = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] database.db_inc_retry_interval = True {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] database.db_max_retries = 20 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] database.db_max_retry_interval = 10 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] database.db_retry_interval = 1 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] database.max_overflow = 50 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] database.max_pool_size = 5 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] database.max_retries = 10 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] database.mysql_wsrep_sync_wait = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] database.pool_timeout = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] database.retry_interval = 10 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] database.slave_connection = **** {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] database.sqlite_synchronous = True {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] database.synchronous_reader = True {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] database.use_db_reconnect = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_tracing.insecure = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] profiler.connection_string = messaging:// {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] profiler.enabled = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] profiler.es_doc_type = notification {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] profiler.es_scroll_size = 10000 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] profiler.es_scroll_time = 2m {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] profiler.filter_error_trace = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] profiler.hmac_keys = **** {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] profiler.sentinel_service_name = mymaster {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] profiler.socket_timeout = 0.1 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] profiler.trace_requests = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] profiler.trace_sqlalchemy = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] profiler_jaeger.process_tags = {} {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] profiler_jaeger.service_name_prefix = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] profiler_otlp.service_name_prefix = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_policy.enforce_new_defaults = True {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_policy.policy_default_rule = default {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_policy.policy_file = policy.yaml {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] privsep_osbrick.group = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] privsep_osbrick.helper_command = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] privsep_osbrick.user = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cinder_sys_admin.group = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cinder_sys_admin.helper_command = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] cinder_sys_admin.user = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] service_user.auth_section = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] service_user.auth_type = password {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] service_user.cafile = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] service_user.certfile = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] service_user.collect_timing = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] service_user.insecure = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] service_user.keyfile = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] service_user.send_service_user_token = True {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] service_user.split_loggers = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] service_user.timeout = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] service_user.tls_ciphers = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] service_user.tls_min_version = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] glance.auth_section = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] glance.auth_type = password {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] glance.certfile = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] glance.collect_timing = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] glance.insecure = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] glance.keyfile = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] glance.region_name = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] glance.split_loggers = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] glance.timeout = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] glance.tls_ciphers = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] glance.tls_min_version = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.backend_availability_zone = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.chap_password = **** {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.chap_username = {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.disk_geometry = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.driver_client_cert = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.driver_client_cert_key = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.driver_data_namespace = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.driver_use_ssl = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.extra_capabilities = {} {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.filter_function = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.goodness_function = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack quobyte-client[88094]: Reading configuration file: /etc/quobyte/client.cfg Sep 10 19:40:40 devstack quobyte-client[88094]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.iscsi_target_flags = {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.iscsi_write_cache = on {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.iser_helper = tgtadm {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.iser_ip_address = 192.168.122.138 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.iser_port = 3260 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] CMD "mount.quobyte" returned: 1 in 0.057s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.nas_host = {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.nas_login = admin {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.nas_mount_options = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.nas_password = **** {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.nas_private_key = {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.nas_share_path = {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.num_shell_tries = 3 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.quobyte_volume_url = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.replication_device = **** {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.report_discard_supported = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.reserved_percentage = 0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.target_helper = tgtadm {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.target_ip_address = 192.168.122.138 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.target_port = 3260 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.target_protocol = iscsi {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.trace_flags = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.unique_fqdn_network = True {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.use_chap_auth = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.volume_backend_name = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.volume_clear = zero {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.volume_clear_ionice = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.volume_clear_size = 0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_reports.file_event_handler = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_reports.log_dir = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.backend_availability_zone = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.backend_host = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.chap_password = **** {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.chap_username = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.chiscsi_conf = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.disk_geometry = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.driver_client_cert = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.driver_data_namespace = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.driver_use_ssl = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.extra_capabilities = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.filter_function = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.goodness_function = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack sudo[88095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack sudo[88095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.iser_helper = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.iser_ip_address = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.iser_port = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.iser_target_prefix = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.nas_host = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.nas_login = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.nas_mount_options = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.nas_password = **** {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.nas_private_key = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.nas_share_path = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.nas_ssh_port = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.num_shell_tries = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.nvmet_port_id = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.replication_device = **** {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.report_discard_supported = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.reserved_percentage = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.scst_target_driver = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.storage_protocol = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.target_helper = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.target_ip_address = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.target_port = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.target_prefix = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.target_protocol = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.trace_flags = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.use_chap_auth = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.volume_clear = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.volume_clear_size = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] QuobyteHD.volumes_dir = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.ssl = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_notifications.driver = [] {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_notifications.retry = -1 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] key_manager.fixed_key = **** {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] barbican.barbican_api_version = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] barbican.barbican_endpoint = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] barbican.barbican_endpoint_type = public {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] barbican.barbican_region_name = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] barbican.cafile = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] barbican.certfile = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] barbican.collect_timing = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] barbican.insecure = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] barbican.keyfile = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] barbican.number_of_retries = 60 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] barbican.retry_delay = 1 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] barbican.send_service_user_token = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] barbican.split_loggers = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] barbican.timeout = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] barbican.tls_ciphers = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] barbican.tls_min_version = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] barbican.verify_ssl = True {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] barbican.verify_ssl_path = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] barbican_service_user.auth_section = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] barbican_service_user.auth_type = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] barbican_service_user.cafile = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] barbican_service_user.certfile = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] barbican_service_user.collect_timing = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] barbican_service_user.insecure = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] barbican_service_user.keyfile = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] barbican_service_user.split_loggers = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] barbican_service_user.timeout = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] barbican_service_user.tls_ciphers = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] barbican_service_user.tls_min_version = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] vault.approle_role_id = **** {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] vault.approle_secret_id = **** {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] vault.auth_method = approle {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] vault.auth_path = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] vault.kv_mountpoint = secret {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] vault.kv_path = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] vault.kv_version = 2 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] vault.namespace = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] vault.root_token_id = **** {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] vault.ssl_ca_crt_file = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] vault.timeout = 60.0 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] vault.token_file = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] vault.token_role = None {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] vault.use_ssl = False {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:40:40 devstack cinder-volume[88034]: DEBUG oslo_service.backend._eventlet.service [None req-23d8f771-e48c-4566-a911-9f9e35a54393 None None] ******************************************************************************** {{(pid=88034) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 10 19:40:41 devstack sudo[88095]: pam_unix(sudo:session): session closed for user root Sep 10 19:40:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.233s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:40:41 devstack cinder-volume[88093]: INFO cinder.volume.driver [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Driver hasn't implemented _init_vendor_properties() Sep 10 19:40:41 devstack cinder-volume[88093]: DEBUG cinder.volume.driver [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.2748527526855, 'free_capacity_gb': 1773.2748527526855, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88093) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 10 19:40:41 devstack cinder-volume[88093]: DEBUG oslo_db.sqlalchemy.engines [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88093) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 19:40:41 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writer thread running {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 10 19:40:41 devstack cinder-volume[88093]: DEBUG cinder.db.api [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Building query based on filter {{(pid=88093) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 10 19:40:41 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88093) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 10 19:40:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:40:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:40:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:40:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:40:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:40:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:40:41 devstack cinder-volume[88093]: INFO cinder.keymgr.migration [None req-102a4ba2-fdfb-4383-bd17-ced466c6efa1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 10 19:40:41 devstack sudo[88098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:40:41 devstack sudo[88098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:40:41 devstack sudo[88098]: pam_unix(sudo:session): session closed for user root Sep 10 19:40:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.214s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:40:41 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:40:41 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Driver initialization completed successfully. Sep 10 19:40:41 devstack cinder-volume[88093]: INFO cinder.manager [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Initiating service 3 cleanup Sep 10 19:40:41 devstack cinder-volume[88093]: INFO cinder.manager [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Service 3 cleanup completed. Sep 10 19:40:41 devstack cinder-volume[88093]: DEBUG cinder.service [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Creating RPC server for service cinder-volume {{(pid=88093) start /opt/stack/cinder/cinder/service.py:231}} Sep 10 19:40:41 devstack cinder-volume[88093]: DEBUG cinder.service [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88093) start /opt/stack/cinder/cinder/service.py:237}} Sep 10 19:40:41 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 10 19:40:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:40:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:40:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:40:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:40:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:40:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:40:41 devstack sudo[88101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:40:41 devstack sudo[88101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:40:41 devstack sudo[88101]: pam_unix(sudo:session): session closed for user root Sep 10 19:40:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.227s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:40:41 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-9b031ea6-7ec3-4fc7-9667-9a26d6e7413d None None] Driver post RPC initialization completed successfully. Sep 10 19:40:50 devstack cinder-volume[88034]: DEBUG dbcounter [-] [88034] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:40:51 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:40:51 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=4 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:41:03 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager._thread_info {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:41:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread count: 6 {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 19:41:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread info: [<_MainThread(MainThread, started 138417491665024)>, , , , , ] {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 19:42:03 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:42:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:42:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:42:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:42:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:42:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:42:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:42:03 devstack sudo[88491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:42:03 devstack sudo[88491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:42:04 devstack sudo[88491]: pam_unix(sudo:session): session closed for user root Sep 10 19:42:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.257s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:42:04 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:42:04 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager._thread_info {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:42:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread count: 6 {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 19:42:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread info: [<_MainThread(MainThread, started 138417491665024)>, , , , , ] {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 19:42:51 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=1 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:42:51 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:UPDATE=1 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:43:03 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:43:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:43:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:43:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:43:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:43:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:43:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:43:03 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:43:03 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:43:04 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Sep 10 19:43:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.364s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:43:04 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:43:04 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager._thread_info {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:43:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread count: 6 {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 19:43:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread info: [<_MainThread(MainThread, started 138417491665024)>, , , , , ] {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 19:43:38 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:43:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] Flow 'volume_create_manager' (670e4b4a-d4fa-4325-adf0-4b7c75f15374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:43:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da434c0-96ee-495c-b9b5-a930fa8e8203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:43:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da434c0-96ee-495c-b9b5-a930fa8e8203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-991605931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=497eae6c-5935-43a1-a401-788264cf39d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09adaa1a82d43259e0911b6a5eb9e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:43:38Z,use_quota=True,user_id='8912c07d705c4a0fb357f80cdb8448ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:43:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29e07f4-7b42-4ea6-9ff2-985f5826e002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:43:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29e07f4-7b42-4ea6-9ff2-985f5826e002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:43:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a0ad2d-8562-46fb-8eeb-e11093e24bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:43:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a0ad2d-8562-46fb-8eeb-e11093e24bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '497eae6c-5935-43a1-a401-788264cf39d3', 'volume_name': 'volume-497eae6c-5935-43a1-a401-788264cf39d3', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:43:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8844ec32-ecb4-4c4c-b2bd-1b43e8bdcb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:43:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8844ec32-ecb4-4c4c-b2bd-1b43e8bdcb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:43:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d4d627-9add-4f4a-8d23-d71fc74ea8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:43:38 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] Volume 497eae6c-5935-43a1-a401-788264cf39d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-497eae6c-5935-43a1-a401-788264cf39d3', 'volume_size': 1} Sep 10 19:43:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:43:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:43:38 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-991605931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=497eae6c-5935-43a1-a401-788264cf39d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09adaa1a82d43259e0911b6a5eb9e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:43:38Z,use_quota=True,user_id='8912c07d705c4a0fb357f80cdb8448ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:43:38 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] Creating volume 497eae6c-5935-43a1-a401-788264cf39d3 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:43:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:43:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:43:38 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:43:38 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:43:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:43:38 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:43:38 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:43:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-497eae6c-5935-43a1-a401-788264cf39d3 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:43:38 devstack sudo[89237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-497eae6c-5935-43a1-a401-788264cf39d3 1073741824 Sep 10 19:43:38 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:43:39 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root Sep 10 19:43:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-497eae6c-5935-43a1-a401-788264cf39d3 1073741824" returned: 0 in 1.422s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:43:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-497eae6c-5935-43a1-a401-788264cf39d3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:43:40 devstack sudo[89559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-497eae6c-5935-43a1-a401-788264cf39d3 Sep 10 19:43:40 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:43:40 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root Sep 10 19:43:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-497eae6c-5935-43a1-a401-788264cf39d3" returned: 0 in 0.657s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:43:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] <== create_volume: return (2231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:43:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.241s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:43:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d4d627-9add-4f4a-8d23-d71fc74ea8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-497eae6c-5935-43a1-a401-788264cf39d3', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:43:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7243c0f-a787-46c5-b907-502c8dc93885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:43:40 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] Volume volume-497eae6c-5935-43a1-a401-788264cf39d3 (497eae6c-5935-43a1-a401-788264cf39d3): created successfully Sep 10 19:43:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7243c0f-a787-46c5-b907-502c8dc93885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:43:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] Flow 'volume_create_manager' (670e4b4a-d4fa-4325-adf0-4b7c75f15374) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:43:40 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-0e5399fc-d7b3-45c2-8603-274aefac6c1c tempest-VolumesAdminNegativeTest-1449407330 None] Created volume successfully. Sep 10 19:43:41 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:43:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] Flow 'volume_create_manager' (e491c16e-018e-4b38-8c50-019cae85a0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:43:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a48c3c97-e3ae-4a83-b484-727e19eb5d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:43:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a48c3c97-e3ae-4a83-b484-727e19eb5d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2100401045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79cefba4-2e08-4576-b57f-d32b5151c47f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d79cec2bff3741f2aa98f8a01a412aef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:43:41Z,use_quota=True,user_id='fd981fab238d4f6a9d3fe3627f093eef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:43:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113b7118-5ba1-4d54-8c28-4d50d02877d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:43:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113b7118-5ba1-4d54-8c28-4d50d02877d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:43:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55e9503-e997-4302-9b6c-5d9fe54451e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:43:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55e9503-e997-4302-9b6c-5d9fe54451e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79cefba4-2e08-4576-b57f-d32b5151c47f', 'volume_name': 'volume-79cefba4-2e08-4576-b57f-d32b5151c47f', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:43:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8165d70a-f4e9-4708-81ad-595529c59837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:43:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8165d70a-f4e9-4708-81ad-595529c59837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:43:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (756f9654-0561-4173-9433-2aa27a97c396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:43:41 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] Volume 79cefba4-2e08-4576-b57f-d32b5151c47f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79cefba4-2e08-4576-b57f-d32b5151c47f', 'volume_size': 1} Sep 10 19:43:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:43:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:43:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2100401045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79cefba4-2e08-4576-b57f-d32b5151c47f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d79cec2bff3741f2aa98f8a01a412aef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:43:41Z,use_quota=True,user_id='fd981fab238d4f6a9d3fe3627f093eef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:43:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] Creating volume 79cefba4-2e08-4576-b57f-d32b5151c47f {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:43:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:43:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:43:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:43:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:43:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:43:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:43:41 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:43:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-79cefba4-2e08-4576-b57f-d32b5151c47f 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:43:41 devstack sudo[89582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-79cefba4-2e08-4576-b57f-d32b5151c47f 1073741824 Sep 10 19:43:41 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:43:42 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root Sep 10 19:43:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-79cefba4-2e08-4576-b57f-d32b5151c47f 1073741824" returned: 0 in 1.135s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:43:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-79cefba4-2e08-4576-b57f-d32b5151c47f {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:43:42 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-79cefba4-2e08-4576-b57f-d32b5151c47f Sep 10 19:43:42 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:43:43 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Sep 10 19:43:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-79cefba4-2e08-4576-b57f-d32b5151c47f" returned: 0 in 0.685s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:43:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] <== create_volume: return (1947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:43:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:43:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (756f9654-0561-4173-9433-2aa27a97c396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79cefba4-2e08-4576-b57f-d32b5151c47f', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:43:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65c35a20-9f47-4713-9426-abc3f8b97b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:43:43 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] Volume volume-79cefba4-2e08-4576-b57f-d32b5151c47f (79cefba4-2e08-4576-b57f-d32b5151c47f): created successfully Sep 10 19:43:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65c35a20-9f47-4713-9426-abc3f8b97b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:43:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] Flow 'volume_create_manager' (e491c16e-018e-4b38-8c50-019cae85a0f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:43:43 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-abb00113-17bd-45e3-9270-b5ea7e5e89c2 tempest-ServerRescueNegativeTestJSON-813614390 None] Created volume successfully. Sep 10 19:43:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-630b38ed-0bfb-46d1-acfb-e54a6b9d897a tempest-VolumesAdminNegativeTest-1449407330 None] Acquiring lock "cinder-497eae6c-5935-43a1-a401-788264cf39d3-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:43:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-630b38ed-0bfb-46d1-acfb-e54a6b9d897a tempest-VolumesAdminNegativeTest-1449407330 None] Lock "cinder-497eae6c-5935-43a1-a401-788264cf39d3-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:43:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-630b38ed-0bfb-46d1-acfb-e54a6b9d897a tempest-VolumesAdminNegativeTest-1449407330 None] Acquiring lock "cinder-quobyte-497eae6c-5935-43a1-a401-788264cf39d3" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:43:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-630b38ed-0bfb-46d1-acfb-e54a6b9d897a tempest-VolumesAdminNegativeTest-1449407330 None] Lock "cinder-quobyte-497eae6c-5935-43a1-a401-788264cf39d3" acquired by "delete_volume" :: waited 0.036s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:43:43 devstack cinder-volume[88093]: INFO oslo.privsep.daemon [None req-630b38ed-0bfb-46d1-acfb-e54a6b9d897a tempest-VolumesAdminNegativeTest-1449407330 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpsarif6qm/privsep.sock'] Sep 10 19:43:43 devstack sudo[89604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpsarif6qm/privsep.sock Sep 10 19:43:43 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:43:46 devstack cinder-volume[88093]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 10 19:43:46 devstack cinder-volume[88093]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 10 19:43:46 devstack cinder-volume[88093]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 10 19:43:46 devstack cinder-volume[88093]: WARNING oslo.privsep.daemon [-] privsep log: Sep 10 19:43:46 devstack cinder-volume[88093]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 10 19:43:46 devstack cinder-volume[88093]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 10 19:43:46 devstack cinder-volume[88093]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 10 19:43:46 devstack cinder-volume[88093]: WARNING oslo.privsep.daemon [-] privsep log: Sep 10 19:43:46 devstack cinder-volume[88093]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 10 19:43:46 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root Sep 10 19:43:46 devstack cinder-volume[88093]: INFO oslo.privsep.daemon [None req-630b38ed-0bfb-46d1-acfb-e54a6b9d897a tempest-VolumesAdminNegativeTest-1449407330 None] Spawned new privsep daemon via rootwrap Sep 10 19:43:46 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [None req-630b38ed-0bfb-46d1-acfb-e54a6b9d897a tempest-VolumesAdminNegativeTest-1449407330 None] Accepted privsep connection to /tmp/tmpsarif6qm/privsep.sock {{(pid=88093) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 10 19:43:46 devstack cinder-volume[88093]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 10 19:43:46 devstack cinder-volume[88093]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 10 19:43:46 devstack cinder-volume[88093]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 10 19:43:46 devstack cinder-volume[88093]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89615 Sep 10 19:43:46 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b05466-92e6-4bdd-901a-371620eed80e]: (2,) {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:43:46 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa15494-5ab7-44b6-b19b-3b0952d8222e]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:43:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-630b38ed-0bfb-46d1-acfb-e54a6b9d897a tempest-VolumesAdminNegativeTest-1449407330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-497eae6c-5935-43a1-a401-788264cf39d3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:43:47 devstack sudo[89617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-497eae6c-5935-43a1-a401-788264cf39d3 Sep 10 19:43:47 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:43:48 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root Sep 10 19:43:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-630b38ed-0bfb-46d1-acfb-e54a6b9d897a tempest-VolumesAdminNegativeTest-1449407330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-497eae6c-5935-43a1-a401-788264cf39d3" returned: 0 in 1.180s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:43:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-630b38ed-0bfb-46d1-acfb-e54a6b9d897a tempest-VolumesAdminNegativeTest-1449407330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-497eae6c-5935-43a1-a401-788264cf39d3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:43:48 devstack sudo[89623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-497eae6c-5935-43a1-a401-788264cf39d3 Sep 10 19:43:48 devstack sudo[89623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:43:48 devstack sudo[89623]: pam_unix(sudo:session): session closed for user root Sep 10 19:43:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-630b38ed-0bfb-46d1-acfb-e54a6b9d897a tempest-VolumesAdminNegativeTest-1449407330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-497eae6c-5935-43a1-a401-788264cf39d3" returned: 0 in 0.712s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:43:48 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-630b38ed-0bfb-46d1-acfb-e54a6b9d897a tempest-VolumesAdminNegativeTest-1449407330 None] Lock "cinder-quobyte-497eae6c-5935-43a1-a401-788264cf39d3" released by "delete_volume" :: held 4.965s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:43:48 devstack cinder-volume[88093]: WARNING cinder.quota [None req-630b38ed-0bfb-46d1-acfb-e54a6b9d897a tempest-VolumesAdminNegativeTest-1449407330 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:43:48 devstack cinder-volume[88093]: WARNING cinder.quota [None req-630b38ed-0bfb-46d1-acfb-e54a6b9d897a tempest-VolumesAdminNegativeTest-1449407330 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:43:48 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-630b38ed-0bfb-46d1-acfb-e54a6b9d897a tempest-VolumesAdminNegativeTest-1449407330 None] Created reservations ['00972dfd-7ba4-4096-9e67-bc2f64169a7a', '999190b1-d42a-4faa-b36c-f24ad8223320', 'dfaef462-11e1-4fec-b562-a1f1c131c0ce', '53e4029d-9c60-4c50-b23b-dded73398650'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:43:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-630b38ed-0bfb-46d1-acfb-e54a6b9d897a tempest-VolumesAdminNegativeTest-1449407330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:43:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-630b38ed-0bfb-46d1-acfb-e54a6b9d897a tempest-VolumesAdminNegativeTest-1449407330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:43:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-630b38ed-0bfb-46d1-acfb-e54a6b9d897a tempest-VolumesAdminNegativeTest-1449407330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:43:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-630b38ed-0bfb-46d1-acfb-e54a6b9d897a tempest-VolumesAdminNegativeTest-1449407330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:43:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-630b38ed-0bfb-46d1-acfb-e54a6b9d897a tempest-VolumesAdminNegativeTest-1449407330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:43:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-630b38ed-0bfb-46d1-acfb-e54a6b9d897a tempest-VolumesAdminNegativeTest-1449407330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:43:49 devstack sudo[89639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:43:49 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:43:49 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root Sep 10 19:43:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-630b38ed-0bfb-46d1-acfb-e54a6b9d897a tempest-VolumesAdminNegativeTest-1449407330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.501s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:43:49 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-630b38ed-0bfb-46d1-acfb-e54a6b9d897a tempest-VolumesAdminNegativeTest-1449407330 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:43:49 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-630b38ed-0bfb-46d1-acfb-e54a6b9d897a tempest-VolumesAdminNegativeTest-1449407330 None] Deleted volume successfully. Sep 10 19:43:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-630b38ed-0bfb-46d1-acfb-e54a6b9d897a tempest-VolumesAdminNegativeTest-1449407330 None] Lock "cinder-497eae6c-5935-43a1-a401-788264cf39d3-delete_volume" released by "delete_volume" :: held 6.048s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:43:59 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:UPDATE=11,cinder:SELECT=9,cinder:DELETE=1,cinder:INSERT=2 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:43:59 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=9,cinder:UPDATE=17,cinder:INSERT=4,cinder:DELETE=2 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:44:03 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:44:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:44:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:44:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:44:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:44:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:44:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:44:03 devstack sudo[89796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:44:03 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:44:04 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root Sep 10 19:44:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.558s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:44:04 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:44:04 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager._thread_info {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:44:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread count: 8 {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 19:44:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread info: [<_MainThread(MainThread, started 138417491665024)>, , , , , , , ] {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 19:44:05 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f1c3deeb-9a25-4053-9d5a-565a675451f1 tempest-ServerRescueNegativeTestJSON-813614390 None] Acquiring lock "cinder-79cefba4-2e08-4576-b57f-d32b5151c47f-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:44:05 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f1c3deeb-9a25-4053-9d5a-565a675451f1 tempest-ServerRescueNegativeTestJSON-813614390 None] Lock "cinder-79cefba4-2e08-4576-b57f-d32b5151c47f-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:44:05 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f1c3deeb-9a25-4053-9d5a-565a675451f1 tempest-ServerRescueNegativeTestJSON-813614390 None] Acquiring lock "cinder-quobyte-79cefba4-2e08-4576-b57f-d32b5151c47f" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:44:05 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f1c3deeb-9a25-4053-9d5a-565a675451f1 tempest-ServerRescueNegativeTestJSON-813614390 None] Lock "cinder-quobyte-79cefba4-2e08-4576-b57f-d32b5151c47f" acquired by "delete_volume" :: waited 0.023s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:44:05 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac76f88-d9a2-463d-9df1-823a547a3fe4]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:44:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1c3deeb-9a25-4053-9d5a-565a675451f1 tempest-ServerRescueNegativeTestJSON-813614390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-79cefba4-2e08-4576-b57f-d32b5151c47f {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:44:05 devstack sudo[89799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-79cefba4-2e08-4576-b57f-d32b5151c47f Sep 10 19:44:05 devstack sudo[89799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:44:06 devstack sudo[89799]: pam_unix(sudo:session): session closed for user root Sep 10 19:44:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1c3deeb-9a25-4053-9d5a-565a675451f1 tempest-ServerRescueNegativeTestJSON-813614390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-79cefba4-2e08-4576-b57f-d32b5151c47f" returned: 0 in 0.443s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:44:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1c3deeb-9a25-4053-9d5a-565a675451f1 tempest-ServerRescueNegativeTestJSON-813614390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-79cefba4-2e08-4576-b57f-d32b5151c47f {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:44:06 devstack sudo[89805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-79cefba4-2e08-4576-b57f-d32b5151c47f Sep 10 19:44:06 devstack sudo[89805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:44:06 devstack sudo[89805]: pam_unix(sudo:session): session closed for user root Sep 10 19:44:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1c3deeb-9a25-4053-9d5a-565a675451f1 tempest-ServerRescueNegativeTestJSON-813614390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-79cefba4-2e08-4576-b57f-d32b5151c47f" returned: 0 in 0.406s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:44:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f1c3deeb-9a25-4053-9d5a-565a675451f1 tempest-ServerRescueNegativeTestJSON-813614390 None] Lock "cinder-quobyte-79cefba4-2e08-4576-b57f-d32b5151c47f" released by "delete_volume" :: held 0.920s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:44:06 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-f1c3deeb-9a25-4053-9d5a-565a675451f1 tempest-ServerRescueNegativeTestJSON-813614390 None] Created reservations ['5b858609-9b92-4ef3-a4a2-d679e3244df0', 'a60f4e7b-df66-4fe0-9344-9694f4bd8633', 'f5c27250-0dec-43f2-966d-faad1572713c', 'a9283b5e-27ca-42ab-ba35-d885bb97fb11'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:44:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1c3deeb-9a25-4053-9d5a-565a675451f1 tempest-ServerRescueNegativeTestJSON-813614390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:44:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1c3deeb-9a25-4053-9d5a-565a675451f1 tempest-ServerRescueNegativeTestJSON-813614390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:44:06 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1c3deeb-9a25-4053-9d5a-565a675451f1 tempest-ServerRescueNegativeTestJSON-813614390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:44:06 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1c3deeb-9a25-4053-9d5a-565a675451f1 tempest-ServerRescueNegativeTestJSON-813614390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:44:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1c3deeb-9a25-4053-9d5a-565a675451f1 tempest-ServerRescueNegativeTestJSON-813614390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:44:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1c3deeb-9a25-4053-9d5a-565a675451f1 tempest-ServerRescueNegativeTestJSON-813614390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:44:06 devstack sudo[89809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:44:06 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:44:07 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root Sep 10 19:44:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1c3deeb-9a25-4053-9d5a-565a675451f1 tempest-ServerRescueNegativeTestJSON-813614390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.484s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:44:07 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-f1c3deeb-9a25-4053-9d5a-565a675451f1 tempest-ServerRescueNegativeTestJSON-813614390 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:44:07 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-f1c3deeb-9a25-4053-9d5a-565a675451f1 tempest-ServerRescueNegativeTestJSON-813614390 None] Deleted volume successfully. Sep 10 19:44:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f1c3deeb-9a25-4053-9d5a-565a675451f1 tempest-ServerRescueNegativeTestJSON-813614390 None] Lock "cinder-79cefba4-2e08-4576-b57f-d32b5151c47f-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:44:11 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:44:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] Flow 'volume_create_manager' (5cb1dd40-756a-4731-b331-669eff53863b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:44:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d355f79-94d6-4055-b86b-1dd5981f601c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:44:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d355f79-94d6-4055-b86b-1dd5981f601c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1253238021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaab1202-41f0-474c-a25f-f58a53f14dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='351795e2277c4c33a0f850111b40b35d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:44:11Z,use_quota=True,user_id='08037bc85f244499b81d879ecdb62e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:44:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (add322da-6dd2-4f2e-b001-764e48b72594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:44:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (add322da-6dd2-4f2e-b001-764e48b72594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:44:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c80cf7e-c940-4e0e-b618-513ac2058e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:44:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c80cf7e-c940-4e0e-b618-513ac2058e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaab1202-41f0-474c-a25f-f58a53f14dce', 'volume_name': 'volume-eaab1202-41f0-474c-a25f-f58a53f14dce', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:44:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9911f4e1-be7d-490d-a7f2-97440f222fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:44:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9911f4e1-be7d-490d-a7f2-97440f222fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:44:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ab076a-bf56-4e00-88bc-41a4cd9a5ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:44:11 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] Volume eaab1202-41f0-474c-a25f-f58a53f14dce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaab1202-41f0-474c-a25f-f58a53f14dce', 'volume_size': 1} Sep 10 19:44:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:44:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:44:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1253238021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaab1202-41f0-474c-a25f-f58a53f14dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='351795e2277c4c33a0f850111b40b35d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:44:11Z,use_quota=True,user_id='08037bc85f244499b81d879ecdb62e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:44:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] Creating volume eaab1202-41f0-474c-a25f-f58a53f14dce {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:44:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:44:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:44:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:44:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:44:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:44:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:44:11 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:44:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-eaab1202-41f0-474c-a25f-f58a53f14dce 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:44:11 devstack sudo[89846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-eaab1202-41f0-474c-a25f-f58a53f14dce 1073741824 Sep 10 19:44:11 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:44:11 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root Sep 10 19:44:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-eaab1202-41f0-474c-a25f-f58a53f14dce 1073741824" returned: 0 in 0.611s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:44:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-eaab1202-41f0-474c-a25f-f58a53f14dce {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:44:11 devstack sudo[89854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-eaab1202-41f0-474c-a25f-f58a53f14dce Sep 10 19:44:11 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:44:12 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root Sep 10 19:44:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-eaab1202-41f0-474c-a25f-f58a53f14dce" returned: 0 in 0.369s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:44:12 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:44:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:44:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ab076a-bf56-4e00-88bc-41a4cd9a5ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaab1202-41f0-474c-a25f-f58a53f14dce', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:44:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68bbb1ef-f57c-49b2-b34b-d6ca608660c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:44:12 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] Volume volume-eaab1202-41f0-474c-a25f-f58a53f14dce (eaab1202-41f0-474c-a25f-f58a53f14dce): created successfully Sep 10 19:44:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68bbb1ef-f57c-49b2-b34b-d6ca608660c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:44:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] Flow 'volume_create_manager' (5cb1dd40-756a-4731-b331-669eff53863b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:44:12 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-7c5c64e1-0b56-45de-85e3-9f33f3fe93da tempest-ServerActionsTestOtherA-1390177495 None] Created volume successfully. Sep 10 19:44:21 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=9 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:44:22 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:UPDATE=13,cinder:SELECT=8,cinder:INSERT=2,cinder:DELETE=2 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:44:27 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:44:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] Flow 'volume_create_manager' (a30515a5-9403-4262-9853-9cdfc57dbced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:44:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db34ae3-b951-485e-b7b8-d740e89e25b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:44:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db34ae3-b951-485e-b7b8-d740e89e25b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1344434921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=558f96c2-755d-4e77-bdb8-160539663a7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4dbb2ad301c4dafa80f49af012ff4a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:44:28Z,use_quota=True,user_id='4f53509c55ba4b32a46f83438fa7bf17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:44:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f5121f-7e32-4669-ac17-d8db056109ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:44:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f5121f-7e32-4669-ac17-d8db056109ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:44:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2119e810-6375-4456-a5b7-e9f0557e8ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:44:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2119e810-6375-4456-a5b7-e9f0557e8ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '558f96c2-755d-4e77-bdb8-160539663a7f', 'volume_name': 'volume-558f96c2-755d-4e77-bdb8-160539663a7f', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:44:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe246ac0-6b97-47d3-b69b-b26e115ab301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:44:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe246ac0-6b97-47d3-b69b-b26e115ab301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:44:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df899058-73bf-481f-a646-0195db5a3c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:44:27 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] Volume 558f96c2-755d-4e77-bdb8-160539663a7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-558f96c2-755d-4e77-bdb8-160539663a7f', 'volume_size': 1} Sep 10 19:44:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:44:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:44:27 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1344434921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=558f96c2-755d-4e77-bdb8-160539663a7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4dbb2ad301c4dafa80f49af012ff4a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:44:28Z,use_quota=True,user_id='4f53509c55ba4b32a46f83438fa7bf17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:44:27 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] Creating volume 558f96c2-755d-4e77-bdb8-160539663a7f {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:44:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:44:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:44:27 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:44:27 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:44:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:44:27 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:44:27 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:44:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-558f96c2-755d-4e77-bdb8-160539663a7f 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:44:27 devstack sudo[90097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-558f96c2-755d-4e77-bdb8-160539663a7f 1073741824 Sep 10 19:44:27 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:44:28 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root Sep 10 19:44:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-558f96c2-755d-4e77-bdb8-160539663a7f 1073741824" returned: 0 in 0.934s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:44:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-558f96c2-755d-4e77-bdb8-160539663a7f {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:44:28 devstack sudo[90107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-558f96c2-755d-4e77-bdb8-160539663a7f Sep 10 19:44:28 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:44:29 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root Sep 10 19:44:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-558f96c2-755d-4e77-bdb8-160539663a7f" returned: 0 in 0.390s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:44:29 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:44:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:44:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df899058-73bf-481f-a646-0195db5a3c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-558f96c2-755d-4e77-bdb8-160539663a7f', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:44:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee770679-3ea9-4dfd-aae6-04e71dd29c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:44:29 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] Volume volume-558f96c2-755d-4e77-bdb8-160539663a7f (558f96c2-755d-4e77-bdb8-160539663a7f): created successfully Sep 10 19:44:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee770679-3ea9-4dfd-aae6-04e71dd29c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:44:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] Flow 'volume_create_manager' (a30515a5-9403-4262-9853-9cdfc57dbced) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:44:29 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-9286169c-47a1-4a29-9ad4-991b2d2e22cc tempest-DeleteServersTestJSON-1304116368 None] Created volume successfully. Sep 10 19:44:35 devstack cinder-volume[88093]: WARNING py.warnings [req-10fb7aaa-b6ef-415a-81af-91f1158b9789 req-b7f26cc3-9020-4892-afa7-5fcebdc7d6ba tempest-DeleteServersTestJSON-1304116368 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 10 19:44:35 devstack cinder-volume[88093]: .first() Sep 10 19:44:35 devstack cinder-volume[88093]: Sep 10 19:44:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-10fb7aaa-b6ef-415a-81af-91f1158b9789 req-b7f26cc3-9020-4892-afa7-5fcebdc7d6ba tempest-DeleteServersTestJSON-1304116368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:44:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-10fb7aaa-b6ef-415a-81af-91f1158b9789 req-b7f26cc3-9020-4892-afa7-5fcebdc7d6ba tempest-DeleteServersTestJSON-1304116368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:44:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-10fb7aaa-b6ef-415a-81af-91f1158b9789 req-b7f26cc3-9020-4892-afa7-5fcebdc7d6ba tempest-DeleteServersTestJSON-1304116368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:44:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-10fb7aaa-b6ef-415a-81af-91f1158b9789 req-b7f26cc3-9020-4892-afa7-5fcebdc7d6ba tempest-DeleteServersTestJSON-1304116368 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3', 'name': 'volume-558f96c2-755d-4e77-bdb8-160539663a7f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9ca26b7-930f-4feb-8119-dcc68a12ebe5', 'enforce_multipath': True} {{(pid=88093) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 19:44:35 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-10fb7aaa-b6ef-415a-81af-91f1158b9789 req-b7f26cc3-9020-4892-afa7-5fcebdc7d6ba tempest-DeleteServersTestJSON-1304116368 None] attachment_update completed successfully. Sep 10 19:44:41 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-cf9366b4-ae66-4092-a9e4-64a8d171998c req-d07ecaeb-a2d3-4f59-bca4-7dc2dcc1f4e6 tempest-DeleteServersTestJSON-1304116368 None] Terminate volume connection completed successfully. Sep 10 19:44:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-cf9366b4-ae66-4092-a9e4-64a8d171998c req-d07ecaeb-a2d3-4f59-bca4-7dc2dcc1f4e6 tempest-DeleteServersTestJSON-1304116368 None] Deleting attachment b9ca26b7-930f-4feb-8119-dcc68a12ebe5. {{(pid=88093) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 19:44:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3b2f9b4e-9fd8-4b6a-b2b5-f480c128d0a7 tempest-DeleteServersTestJSON-1304116368 None] Acquiring lock "cinder-558f96c2-755d-4e77-bdb8-160539663a7f-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:44:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3b2f9b4e-9fd8-4b6a-b2b5-f480c128d0a7 tempest-DeleteServersTestJSON-1304116368 None] Lock "cinder-558f96c2-755d-4e77-bdb8-160539663a7f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:44:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3b2f9b4e-9fd8-4b6a-b2b5-f480c128d0a7 tempest-DeleteServersTestJSON-1304116368 None] Acquiring lock "cinder-quobyte-558f96c2-755d-4e77-bdb8-160539663a7f" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:44:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3b2f9b4e-9fd8-4b6a-b2b5-f480c128d0a7 tempest-DeleteServersTestJSON-1304116368 None] Lock "cinder-quobyte-558f96c2-755d-4e77-bdb8-160539663a7f" acquired by "delete_volume" :: waited 0.023s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:44:43 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[785ad4dc-28bf-4517-a656-5742a839f226]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:44:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3b2f9b4e-9fd8-4b6a-b2b5-f480c128d0a7 tempest-DeleteServersTestJSON-1304116368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-558f96c2-755d-4e77-bdb8-160539663a7f {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:44:44 devstack sudo[90642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-558f96c2-755d-4e77-bdb8-160539663a7f Sep 10 19:44:44 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:44:44 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root Sep 10 19:44:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3b2f9b4e-9fd8-4b6a-b2b5-f480c128d0a7 tempest-DeleteServersTestJSON-1304116368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-558f96c2-755d-4e77-bdb8-160539663a7f" returned: 0 in 0.507s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:44:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3b2f9b4e-9fd8-4b6a-b2b5-f480c128d0a7 tempest-DeleteServersTestJSON-1304116368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-558f96c2-755d-4e77-bdb8-160539663a7f {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:44:44 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-558f96c2-755d-4e77-bdb8-160539663a7f Sep 10 19:44:44 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:44:44 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Sep 10 19:44:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3b2f9b4e-9fd8-4b6a-b2b5-f480c128d0a7 tempest-DeleteServersTestJSON-1304116368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-558f96c2-755d-4e77-bdb8-160539663a7f" returned: 0 in 0.316s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:44:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3b2f9b4e-9fd8-4b6a-b2b5-f480c128d0a7 tempest-DeleteServersTestJSON-1304116368 None] Lock "cinder-quobyte-558f96c2-755d-4e77-bdb8-160539663a7f" released by "delete_volume" :: held 0.885s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:44:44 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-3b2f9b4e-9fd8-4b6a-b2b5-f480c128d0a7 tempest-DeleteServersTestJSON-1304116368 None] Created reservations ['57ac8b9d-a65a-4da1-a98c-97bf27ef3507', 'fb4b82e3-c7cc-485d-b628-6597562e2325', 'a89b006d-800f-474a-acda-76d44626fc72', '09c80965-f819-4e85-abb5-6176319ecd2b'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:44:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3b2f9b4e-9fd8-4b6a-b2b5-f480c128d0a7 tempest-DeleteServersTestJSON-1304116368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:44:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3b2f9b4e-9fd8-4b6a-b2b5-f480c128d0a7 tempest-DeleteServersTestJSON-1304116368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:44:44 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3b2f9b4e-9fd8-4b6a-b2b5-f480c128d0a7 tempest-DeleteServersTestJSON-1304116368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:44:44 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3b2f9b4e-9fd8-4b6a-b2b5-f480c128d0a7 tempest-DeleteServersTestJSON-1304116368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:44:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3b2f9b4e-9fd8-4b6a-b2b5-f480c128d0a7 tempest-DeleteServersTestJSON-1304116368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:44:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3b2f9b4e-9fd8-4b6a-b2b5-f480c128d0a7 tempest-DeleteServersTestJSON-1304116368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:44:44 devstack sudo[90651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:44:44 devstack sudo[90651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:44:45 devstack sudo[90651]: pam_unix(sudo:session): session closed for user root Sep 10 19:44:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3b2f9b4e-9fd8-4b6a-b2b5-f480c128d0a7 tempest-DeleteServersTestJSON-1304116368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.263s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:44:45 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-3b2f9b4e-9fd8-4b6a-b2b5-f480c128d0a7 tempest-DeleteServersTestJSON-1304116368 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:44:45 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-3b2f9b4e-9fd8-4b6a-b2b5-f480c128d0a7 tempest-DeleteServersTestJSON-1304116368 None] Deleted volume successfully. Sep 10 19:44:45 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3b2f9b4e-9fd8-4b6a-b2b5-f480c128d0a7 tempest-DeleteServersTestJSON-1304116368 None] Lock "cinder-558f96c2-755d-4e77-bdb8-160539663a7f-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:44:54 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=14,cinder:UPDATE=14,cinder:INSERT=3 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:44:55 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=16,cinder:UPDATE=12,cinder:DELETE=2,cinder:INSERT=2 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:44:58 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:44:58 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Flow 'volume_create_manager' (3de870d9-28cc-4a26-87db-864b9c3cca86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:44:58 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38e47bb7-526b-4be9-83d2-179b0da00d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:44:58 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38e47bb7-526b-4be9-83d2-179b0da00d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-610860838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d427c7-20d4-4a06-bc08-50d0505a56cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32c8c301b02346a69822fccd0aa1c8c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:44:59Z,use_quota=True,user_id='10256e71a3c24a719f72ed9ca196f592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:44:58 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f1b42e-aad5-41a9-ada8-6866beb59ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:44:58 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f1b42e-aad5-41a9-ada8-6866beb59ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:44:58 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e51d3de-3036-44fe-b909-28be10fe71b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:44:58 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e51d3de-3036-44fe-b909-28be10fe71b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04d427c7-20d4-4a06-bc08-50d0505a56cf', 'volume_name': 'volume-04d427c7-20d4-4a06-bc08-50d0505a56cf', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:44:58 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ce5e02-04d3-4434-919d-d670f27b2264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:44:58 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ce5e02-04d3-4434-919d-d670f27b2264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:44:58 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4a605e6-de84-4ff3-9234-34c58fcc5dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:44:58 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Volume 04d427c7-20d4-4a06-bc08-50d0505a56cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04d427c7-20d4-4a06-bc08-50d0505a56cf', 'volume_size': 1} Sep 10 19:44:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:44:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:44:58 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-610860838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d427c7-20d4-4a06-bc08-50d0505a56cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32c8c301b02346a69822fccd0aa1c8c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:44:59Z,use_quota=True,user_id='10256e71a3c24a719f72ed9ca196f592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:44:58 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Creating volume 04d427c7-20d4-4a06-bc08-50d0505a56cf {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:44:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:44:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:44:58 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:44:58 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:44:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:44:58 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:44:58 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:44:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-04d427c7-20d4-4a06-bc08-50d0505a56cf 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:44:58 devstack sudo[90671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-04d427c7-20d4-4a06-bc08-50d0505a56cf 1073741824 Sep 10 19:44:58 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:44:59 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root Sep 10 19:44:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-0bcb573f-91a9-4a37-bff4-da07e487333a req-60728cde-2a19-4d34-93a1-edf6cf448bc3 tempest-ServerActionsTestOtherA-1390177495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:44:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-04d427c7-20d4-4a06-bc08-50d0505a56cf 1073741824" returned: 0 in 0.738s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:44:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-04d427c7-20d4-4a06-bc08-50d0505a56cf {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:44:59 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-04d427c7-20d4-4a06-bc08-50d0505a56cf Sep 10 19:44:59 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:44:59 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Sep 10 19:44:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-04d427c7-20d4-4a06-bc08-50d0505a56cf" returned: 0 in 0.267s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:44:59 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:44:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:44:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-0bcb573f-91a9-4a37-bff4-da07e487333a req-60728cde-2a19-4d34-93a1-edf6cf448bc3 tempest-ServerActionsTestOtherA-1390177495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.358s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:44:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4a605e6-de84-4ff3-9234-34c58fcc5dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04d427c7-20d4-4a06-bc08-50d0505a56cf', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:44:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d995521-f13f-490c-b0b2-bdbd0eb493e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:45:00 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Volume volume-04d427c7-20d4-4a06-bc08-50d0505a56cf (04d427c7-20d4-4a06-bc08-50d0505a56cf): created successfully Sep 10 19:45:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d995521-f13f-490c-b0b2-bdbd0eb493e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:45:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Flow 'volume_create_manager' (3de870d9-28cc-4a26-87db-864b9c3cca86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:45:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-0bcb573f-91a9-4a37-bff4-da07e487333a req-60728cde-2a19-4d34-93a1-edf6cf448bc3 tempest-ServerActionsTestOtherA-1390177495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.121s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:45:00 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-6e5d7e79-8d13-469e-8b84-3ff369f6ab98 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Created volume successfully. Sep 10 19:45:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-0bcb573f-91a9-4a37-bff4-da07e487333a req-60728cde-2a19-4d34-93a1-edf6cf448bc3 tempest-ServerActionsTestOtherA-1390177495 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3', 'name': 'volume-eaab1202-41f0-474c-a25f-f58a53f14dce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff30ddbe-e501-4f6b-92bf-2f06a527b325', 'enforce_multipath': True} {{(pid=88093) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 19:45:00 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-0bcb573f-91a9-4a37-bff4-da07e487333a req-60728cde-2a19-4d34-93a1-edf6cf448bc3 tempest-ServerActionsTestOtherA-1390177495 None] attachment_update completed successfully. Sep 10 19:45:00 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3eb6b386-dac7-4ef9-81b0-df1264721fb2 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Acquiring lock "cinder-04d427c7-20d4-4a06-bc08-50d0505a56cf-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:45:00 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3eb6b386-dac7-4ef9-81b0-df1264721fb2 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Lock "cinder-04d427c7-20d4-4a06-bc08-50d0505a56cf-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:45:00 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3eb6b386-dac7-4ef9-81b0-df1264721fb2 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Acquiring lock "cinder-quobyte-04d427c7-20d4-4a06-bc08-50d0505a56cf" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:45:00 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3eb6b386-dac7-4ef9-81b0-df1264721fb2 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Lock "cinder-quobyte-04d427c7-20d4-4a06-bc08-50d0505a56cf" acquired by "delete_volume" :: waited 0.024s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:45:01 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f2eeda-b5ab-43f7-9823-cb7aae5fda7f]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:45:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3eb6b386-dac7-4ef9-81b0-df1264721fb2 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-04d427c7-20d4-4a06-bc08-50d0505a56cf {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:01 devstack sudo[91074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-04d427c7-20d4-4a06-bc08-50d0505a56cf Sep 10 19:45:01 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:01 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3eb6b386-dac7-4ef9-81b0-df1264721fb2 tempest-VolumeQuotasAdminTestJSON-1169380119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-04d427c7-20d4-4a06-bc08-50d0505a56cf" returned: 0 in 0.593s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3eb6b386-dac7-4ef9-81b0-df1264721fb2 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-04d427c7-20d4-4a06-bc08-50d0505a56cf {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:01 devstack sudo[91083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-04d427c7-20d4-4a06-bc08-50d0505a56cf Sep 10 19:45:01 devstack sudo[91083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:01 devstack sudo[91083]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3eb6b386-dac7-4ef9-81b0-df1264721fb2 tempest-VolumeQuotasAdminTestJSON-1169380119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-04d427c7-20d4-4a06-bc08-50d0505a56cf" returned: 0 in 0.326s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:01 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3eb6b386-dac7-4ef9-81b0-df1264721fb2 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Lock "cinder-quobyte-04d427c7-20d4-4a06-bc08-50d0505a56cf" released by "delete_volume" :: held 0.989s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:45:02 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-3eb6b386-dac7-4ef9-81b0-df1264721fb2 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Created reservations ['d321431b-e0b4-4b2b-b32f-901826764cc0', 'e415da6d-3d6f-4f27-8b81-92b6c461db07', '333b4867-40de-428f-859d-f4847cf56b4c', '1576d1e5-dc1d-41c0-81ff-61793ba7a023'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:45:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3eb6b386-dac7-4ef9-81b0-df1264721fb2 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:45:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3eb6b386-dac7-4ef9-81b0-df1264721fb2 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:45:02 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3eb6b386-dac7-4ef9-81b0-df1264721fb2 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:45:02 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3eb6b386-dac7-4ef9-81b0-df1264721fb2 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:45:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3eb6b386-dac7-4ef9-81b0-df1264721fb2 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:45:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3eb6b386-dac7-4ef9-81b0-df1264721fb2 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:02 devstack sudo[91086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:45:02 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:02 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3eb6b386-dac7-4ef9-81b0-df1264721fb2 tempest-VolumeQuotasAdminTestJSON-1169380119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.301s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:02 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-3eb6b386-dac7-4ef9-81b0-df1264721fb2 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:45:02 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-3eb6b386-dac7-4ef9-81b0-df1264721fb2 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Deleted volume successfully. Sep 10 19:45:02 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3eb6b386-dac7-4ef9-81b0-df1264721fb2 tempest-VolumeQuotasAdminTestJSON-1169380119 None] Lock "cinder-04d427c7-20d4-4a06-bc08-50d0505a56cf-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:45:03 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:45:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] Flow 'volume_create_manager' (8ab712fb-32d8-48d2-a2f2-9391eeaaf3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:45:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec362f00-6692-4a0f-bf34-94fc2c2bda3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:45:03 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:45:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:45:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:45:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:45:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:45:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:45:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:03 devstack sudo[91090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:45:03 devstack sudo[91090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec362f00-6692-4a0f-bf34-94fc2c2bda3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-898690786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d9adf37-2b43-4d83-a010-03d7dd00a755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32c8c301b02346a69822fccd0aa1c8c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:45:04Z,use_quota=True,user_id='10256e71a3c24a719f72ed9ca196f592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:45:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f2d7702-720d-47c3-9601-6126fe60fbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:45:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f2d7702-720d-47c3-9601-6126fe60fbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:45:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d685ca5e-50d5-41f4-8384-1865cb2c7ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:45:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d685ca5e-50d5-41f4-8384-1865cb2c7ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d9adf37-2b43-4d83-a010-03d7dd00a755', 'volume_name': 'volume-9d9adf37-2b43-4d83-a010-03d7dd00a755', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:45:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32327785-4984-405c-8c57-f8826c86d06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:45:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32327785-4984-405c-8c57-f8826c86d06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:45:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ea5763-79d1-4b72-a34a-08d9765959d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:45:03 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] Volume 9d9adf37-2b43-4d83-a010-03d7dd00a755: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d9adf37-2b43-4d83-a010-03d7dd00a755', 'volume_size': 1} Sep 10 19:45:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:45:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:45:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-898690786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d9adf37-2b43-4d83-a010-03d7dd00a755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32c8c301b02346a69822fccd0aa1c8c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:45:04Z,use_quota=True,user_id='10256e71a3c24a719f72ed9ca196f592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:45:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] Creating volume 9d9adf37-2b43-4d83-a010-03d7dd00a755 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:45:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:45:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:45:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:45:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:45:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:45:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:45:03 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:45:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9adf37-2b43-4d83-a010-03d7dd00a755 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:04 devstack sudo[91093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9adf37-2b43-4d83-a010-03d7dd00a755 1073741824 Sep 10 19:45:04 devstack sudo[91093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:04 devstack sudo[91090]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.331s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:04 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:45:04 devstack sudo[91093]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9adf37-2b43-4d83-a010-03d7dd00a755 1073741824" returned: 0 in 0.641s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9adf37-2b43-4d83-a010-03d7dd00a755 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:04 devstack sudo[91104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9adf37-2b43-4d83-a010-03d7dd00a755 Sep 10 19:45:04 devstack sudo[91104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:04 devstack sudo[91104]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9adf37-2b43-4d83-a010-03d7dd00a755" returned: 0 in 0.312s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:45:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:45:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ea5763-79d1-4b72-a34a-08d9765959d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d9adf37-2b43-4d83-a010-03d7dd00a755', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:45:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce9a8e80-cfbe-4786-a948-f1effbd38393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:45:05 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] Volume volume-9d9adf37-2b43-4d83-a010-03d7dd00a755 (9d9adf37-2b43-4d83-a010-03d7dd00a755): created successfully Sep 10 19:45:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce9a8e80-cfbe-4786-a948-f1effbd38393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:45:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] Flow 'volume_create_manager' (8ab712fb-32d8-48d2-a2f2-9391eeaaf3ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:45:05 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-0eff4e62-9178-4b68-aa8c-854ba01ad9ea tempest-VolumeQuotasAdminTestJSON-1169380119 None] Created volume successfully. Sep 10 19:45:05 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-dfc4af32-b036-40ba-9bca-5f8c8fec049d req-0ff38d11-1acc-4587-8df5-0ace821f1508 tempest-ServerActionsTestOtherA-1390177495 None] Terminate volume connection completed successfully. Sep 10 19:45:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-dfc4af32-b036-40ba-9bca-5f8c8fec049d req-0ff38d11-1acc-4587-8df5-0ace821f1508 tempest-ServerActionsTestOtherA-1390177495 None] Deleting attachment ff30ddbe-e501-4f6b-92bf-2f06a527b325. {{(pid=88093) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 19:45:05 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:45:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] Flow 'volume_create_manager' (697a0670-d9b2-44a8-89d8-140ff0b639f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:45:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8f57ff6-b8ca-42d8-8a9b-38960b67e4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:45:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8f57ff6-b8ca-42d8-8a9b-38960b67e4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-748569259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7d34589-80df-45ac-b1f0-36e3d82be876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed99d8d26f540b88742034508228c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:45:06Z,use_quota=True,user_id='68573f29e15b4cfa8a120e2590e7d994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:45:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (155c45eb-cb1a-4811-85a4-8c4c5e3225f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:45:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (155c45eb-cb1a-4811-85a4-8c4c5e3225f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:45:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5892f1d0-5a2b-489a-82ac-a2b379e469be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:45:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5892f1d0-5a2b-489a-82ac-a2b379e469be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7d34589-80df-45ac-b1f0-36e3d82be876', 'volume_name': 'volume-a7d34589-80df-45ac-b1f0-36e3d82be876', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:45:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b239e5-8f5f-465e-a0c1-8baf714bc715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:45:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b239e5-8f5f-465e-a0c1-8baf714bc715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:45:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40bd7572-940a-467a-a866-f359ab2d1b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:45:05 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] Volume a7d34589-80df-45ac-b1f0-36e3d82be876: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7d34589-80df-45ac-b1f0-36e3d82be876', 'volume_size': 1} Sep 10 19:45:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:45:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:45:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-748569259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7d34589-80df-45ac-b1f0-36e3d82be876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed99d8d26f540b88742034508228c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:45:06Z,use_quota=True,user_id='68573f29e15b4cfa8a120e2590e7d994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:45:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] Creating volume a7d34589-80df-45ac-b1f0-36e3d82be876 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:45:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:45:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:45:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:45:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:45:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:45:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:45:05 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:45:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a7d34589-80df-45ac-b1f0-36e3d82be876 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:05 devstack sudo[91148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a7d34589-80df-45ac-b1f0-36e3d82be876 1073741824 Sep 10 19:45:05 devstack sudo[91148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-dfc4af32-b036-40ba-9bca-5f8c8fec049d req-045bdb01-c951-4753-a764-9e9726e24550 tempest-ServerActionsTestOtherA-1390177495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:45:06 devstack sudo[91148]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a7d34589-80df-45ac-b1f0-36e3d82be876 1073741824" returned: 0 in 0.935s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a7d34589-80df-45ac-b1f0-36e3d82be876 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:06 devstack sudo[91186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a7d34589-80df-45ac-b1f0-36e3d82be876 Sep 10 19:45:06 devstack sudo[91186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:07 devstack sudo[91186]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a7d34589-80df-45ac-b1f0-36e3d82be876" returned: 0 in 0.311s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:45:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:45:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-dfc4af32-b036-40ba-9bca-5f8c8fec049d req-045bdb01-c951-4753-a764-9e9726e24550 tempest-ServerActionsTestOtherA-1390177495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.457s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:45:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40bd7572-940a-467a-a866-f359ab2d1b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7d34589-80df-45ac-b1f0-36e3d82be876', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:45:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb77fbd7-fea2-42c2-8239-96e929662816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:45:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-dfc4af32-b036-40ba-9bca-5f8c8fec049d req-045bdb01-c951-4753-a764-9e9726e24550 tempest-ServerActionsTestOtherA-1390177495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.087s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:45:07 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] Volume volume-a7d34589-80df-45ac-b1f0-36e3d82be876 (a7d34589-80df-45ac-b1f0-36e3d82be876): created successfully Sep 10 19:45:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb77fbd7-fea2-42c2-8239-96e929662816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:45:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] Flow 'volume_create_manager' (697a0670-d9b2-44a8-89d8-140ff0b639f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:45:07 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-d1e0e600-0c70-4b4d-b48d-d4c3ed5f2c13 tempest-VolumeQuotasAdminTestJSON-153895196 None] Transfer volume completed successfully. Sep 10 19:45:07 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-c33abc18-cf5e-4945-a897-4959420e6ae0 tempest-TaggedAttachmentsTest-369772138 None] Created volume successfully. Sep 10 19:45:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-dfc4af32-b036-40ba-9bca-5f8c8fec049d req-045bdb01-c951-4753-a764-9e9726e24550 tempest-ServerActionsTestOtherA-1390177495 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3', 'name': 'volume-eaab1202-41f0-474c-a25f-f58a53f14dce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6afbc2dd-2bb0-447e-8842-d3b65f3a60e9', 'enforce_multipath': True} {{(pid=88093) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 19:45:07 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-dfc4af32-b036-40ba-9bca-5f8c8fec049d req-045bdb01-c951-4753-a764-9e9726e24550 tempest-ServerActionsTestOtherA-1390177495 None] attachment_update completed successfully. Sep 10 19:45:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e9918f83-95fa-4bfd-9a6a-3b645f46af05 tempest-VolumeQuotasAdminTestJSON-828092867 None] Acquiring lock "cinder-9d9adf37-2b43-4d83-a010-03d7dd00a755-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:45:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e9918f83-95fa-4bfd-9a6a-3b645f46af05 tempest-VolumeQuotasAdminTestJSON-828092867 None] Lock "cinder-9d9adf37-2b43-4d83-a010-03d7dd00a755-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:45:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e9918f83-95fa-4bfd-9a6a-3b645f46af05 tempest-VolumeQuotasAdminTestJSON-828092867 None] Acquiring lock "cinder-quobyte-9d9adf37-2b43-4d83-a010-03d7dd00a755" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:45:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e9918f83-95fa-4bfd-9a6a-3b645f46af05 tempest-VolumeQuotasAdminTestJSON-828092867 None] Lock "cinder-quobyte-9d9adf37-2b43-4d83-a010-03d7dd00a755" acquired by "delete_volume" :: waited 0.026s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:45:08 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[66061a57-504f-494e-a585-23988283cf31]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:45:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e9918f83-95fa-4bfd-9a6a-3b645f46af05 tempest-VolumeQuotasAdminTestJSON-828092867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9adf37-2b43-4d83-a010-03d7dd00a755 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:08 devstack sudo[91198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9adf37-2b43-4d83-a010-03d7dd00a755 Sep 10 19:45:08 devstack sudo[91198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:08 devstack sudo[91198]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e9918f83-95fa-4bfd-9a6a-3b645f46af05 tempest-VolumeQuotasAdminTestJSON-828092867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9adf37-2b43-4d83-a010-03d7dd00a755" returned: 0 in 0.515s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e9918f83-95fa-4bfd-9a6a-3b645f46af05 tempest-VolumeQuotasAdminTestJSON-828092867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9adf37-2b43-4d83-a010-03d7dd00a755 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:08 devstack sudo[91213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9adf37-2b43-4d83-a010-03d7dd00a755 Sep 10 19:45:08 devstack sudo[91213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:08 devstack sudo[91213]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e9918f83-95fa-4bfd-9a6a-3b645f46af05 tempest-VolumeQuotasAdminTestJSON-828092867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9adf37-2b43-4d83-a010-03d7dd00a755" returned: 0 in 0.342s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e9918f83-95fa-4bfd-9a6a-3b645f46af05 tempest-VolumeQuotasAdminTestJSON-828092867 None] Lock "cinder-quobyte-9d9adf37-2b43-4d83-a010-03d7dd00a755" released by "delete_volume" :: held 0.947s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:45:09 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-e9918f83-95fa-4bfd-9a6a-3b645f46af05 tempest-VolumeQuotasAdminTestJSON-828092867 None] Created reservations ['d5bec35a-f59e-4893-8ef1-1a66dc1463ad', '6dc63d37-760b-45f8-836f-acbf5c04f4d4', 'fda0c266-2525-4f4d-90c0-0200533332e7', '6d63836d-4c20-419c-8180-b9af91660b03'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:45:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e9918f83-95fa-4bfd-9a6a-3b645f46af05 tempest-VolumeQuotasAdminTestJSON-828092867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:45:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e9918f83-95fa-4bfd-9a6a-3b645f46af05 tempest-VolumeQuotasAdminTestJSON-828092867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:45:09 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e9918f83-95fa-4bfd-9a6a-3b645f46af05 tempest-VolumeQuotasAdminTestJSON-828092867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:45:09 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e9918f83-95fa-4bfd-9a6a-3b645f46af05 tempest-VolumeQuotasAdminTestJSON-828092867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:45:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e9918f83-95fa-4bfd-9a6a-3b645f46af05 tempest-VolumeQuotasAdminTestJSON-828092867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:45:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e9918f83-95fa-4bfd-9a6a-3b645f46af05 tempest-VolumeQuotasAdminTestJSON-828092867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:09 devstack sudo[91301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:45:09 devstack sudo[91301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:09 devstack sudo[91301]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e9918f83-95fa-4bfd-9a6a-3b645f46af05 tempest-VolumeQuotasAdminTestJSON-828092867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.380s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:09 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-e9918f83-95fa-4bfd-9a6a-3b645f46af05 tempest-VolumeQuotasAdminTestJSON-828092867 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:45:09 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-e9918f83-95fa-4bfd-9a6a-3b645f46af05 tempest-VolumeQuotasAdminTestJSON-828092867 None] Deleted volume successfully. Sep 10 19:45:09 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e9918f83-95fa-4bfd-9a6a-3b645f46af05 tempest-VolumeQuotasAdminTestJSON-828092867 None] Lock "cinder-9d9adf37-2b43-4d83-a010-03d7dd00a755-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:45:19 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=36,cinder:UPDATE=28,cinder:DELETE=3,cinder:INSERT=6 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:45:19 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:UPDATE=28,cinder:SELECT=25,cinder:INSERT=5,cinder:DELETE=2 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:45:24 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:45:24 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Flow 'volume_create_manager' (7db0cc61-f1da-4302-bdba-ade10a23e9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:45:24 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555007f1-3d35-4e31-930d-a5e47086e112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:45:24 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555007f1-3d35-4e31-930d-a5e47086e112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-875983611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f35a2a5-ada7-4aea-9ef4-d67b555d9336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='968b8ff07eeb43a9bd9b0a6d807db859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:45:24Z,use_quota=True,user_id='9c5f344372bc4937b7741b295b340c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:45:24 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f4e3f6-4de7-43df-a04a-f2bd9cc8e721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:45:24 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f4e3f6-4de7-43df-a04a-f2bd9cc8e721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:45:24 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c312e80f-d435-4359-ad9d-1d90a8c79a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:45:24 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c312e80f-d435-4359-ad9d-1d90a8c79a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f35a2a5-ada7-4aea-9ef4-d67b555d9336', 'volume_name': 'volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:45:24 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b0055b8-a136-4d85-a48c-a74b4dd8368b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:45:24 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b0055b8-a136-4d85-a48c-a74b4dd8368b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:45:24 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e26846d9-55f9-42dc-972b-80f1121eecd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:45:24 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Volume 0f35a2a5-ada7-4aea-9ef4-d67b555d9336: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336', 'volume_size': 1} Sep 10 19:45:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:45:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:45:24 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-875983611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f35a2a5-ada7-4aea-9ef4-d67b555d9336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='968b8ff07eeb43a9bd9b0a6d807db859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:45:24Z,use_quota=True,user_id='9c5f344372bc4937b7741b295b340c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:45:24 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Creating volume 0f35a2a5-ada7-4aea-9ef4-d67b555d9336 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:45:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:45:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:45:24 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:45:24 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:45:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:45:24 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:45:24 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:45:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:24 devstack sudo[91768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336 1073741824 Sep 10 19:45:24 devstack sudo[91768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:25 devstack sudo[91768]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336 1073741824" returned: 0 in 0.786s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:25 devstack sudo[91810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336 Sep 10 19:45:25 devstack sudo[91810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:25 devstack sudo[91810]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336" returned: 0 in 0.431s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:25 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:45:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:45:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e26846d9-55f9-42dc-972b-80f1121eecd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:45:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1831e4ba-84eb-44e9-a8e9-8209378995cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:45:25 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Volume volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336 (0f35a2a5-ada7-4aea-9ef4-d67b555d9336): created successfully Sep 10 19:45:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1831e4ba-84eb-44e9-a8e9-8209378995cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:45:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Flow 'volume_create_manager' (7db0cc61-f1da-4302-bdba-ade10a23e9cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:45:25 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-5f982121-754c-47c9-ad94-2d184ea69ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Created volume successfully. Sep 10 19:45:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cb645a2a-7073-402c-899b-c94c3d3f2547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:45:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cb645a2a-7073-402c-899b-c94c3d3f2547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:45:26 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-cb645a2a-7073-402c-899b-c94c3d3f2547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Creating offline snapshot ef2d3ab4-115f-483c-bc4a-7e659b746bed of volume 0f35a2a5-ada7-4aea-9ef4-d67b555d9336 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 19:45:27 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3edcf2c-067e-4acb-b30f-c36d383b2e62]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:45:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cb645a2a-7073-402c-899b-c94c3d3f2547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:27 devstack sudo[91895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336 Sep 10 19:45:27 devstack sudo[91895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:27 devstack sudo[91895]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cb645a2a-7073-402c-899b-c94c3d3f2547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336" returned: 0 in 0.994s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cb645a2a-7073-402c-899b-c94c3d3f2547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336.ef2d3ab4-115f-483c-bc4a-7e659b746bed 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:28 devstack sudo[91912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336.ef2d3ab4-115f-483c-bc4a-7e659b746bed 1G Sep 10 19:45:28 devstack sudo[91912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:28 devstack sudo[91912]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cb645a2a-7073-402c-899b-c94c3d3f2547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336.ef2d3ab4-115f-483c-bc4a-7e659b746bed 1G" returned: 0 in 0.462s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cb645a2a-7073-402c-899b-c94c3d3f2547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336.ef2d3ab4-115f-483c-bc4a-7e659b746bed {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:28 devstack sudo[91919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336.ef2d3ab4-115f-483c-bc4a-7e659b746bed Sep 10 19:45:28 devstack sudo[91919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:28 devstack sudo[91919]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cb645a2a-7073-402c-899b-c94c3d3f2547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336.ef2d3ab4-115f-483c-bc4a-7e659b746bed" returned: 0 in 0.462s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:28 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-cb645a2a-7073-402c-899b-c94c3d3f2547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336.ef2d3ab4-115f-483c-bc4a-7e659b746bed is being set with open permissions: ugo+rw Sep 10 19:45:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cb645a2a-7073-402c-899b-c94c3d3f2547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336.ef2d3ab4-115f-483c-bc4a-7e659b746bed {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:28 devstack sudo[91952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336.ef2d3ab4-115f-483c-bc4a-7e659b746bed Sep 10 19:45:28 devstack sudo[91952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:29 devstack sudo[91952]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cb645a2a-7073-402c-899b-c94c3d3f2547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336.ef2d3ab4-115f-483c-bc4a-7e659b746bed" returned: 0 in 0.397s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cb645a2a-7073-402c-899b-c94c3d3f2547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:29 devstack sudo[91955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336.info Sep 10 19:45:29 devstack sudo[91955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:29 devstack sudo[91955]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cb645a2a-7073-402c-899b-c94c3d3f2547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336.info" returned: 0 in 0.369s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:29 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-cb645a2a-7073-402c-899b-c94c3d3f2547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336.info is being set with open permissions: ugo+rw Sep 10 19:45:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cb645a2a-7073-402c-899b-c94c3d3f2547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:29 devstack sudo[91958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336.info Sep 10 19:45:29 devstack sudo[91958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:30 devstack sudo[91958]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cb645a2a-7073-402c-899b-c94c3d3f2547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336.info" returned: 0 in 0.451s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cb645a2a-7073-402c-899b-c94c3d3f2547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.320s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:45:30 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-cb645a2a-7073-402c-899b-c94c3d3f2547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Create snapshot completed successfully Sep 10 19:45:32 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-13db3951-6ba2-4410-a87b-e37635dde575 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Acquiring lock "cinder-ef2d3ab4-115f-483c-bc4a-7e659b746bed-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:45:32 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-13db3951-6ba2-4410-a87b-e37635dde575 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Lock "cinder-ef2d3ab4-115f-483c-bc4a-7e659b746bed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:45:32 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-13db3951-6ba2-4410-a87b-e37635dde575 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Acquiring lock "cinder-quobyte-0f35a2a5-ada7-4aea-9ef4-d67b555d9336" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:45:32 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-13db3951-6ba2-4410-a87b-e37635dde575 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Lock "cinder-quobyte-0f35a2a5-ada7-4aea-9ef4-d67b555d9336" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:45:32 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-13db3951-6ba2-4410-a87b-e37635dde575 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Acquiring lock "cinder-quobyte-ef2d3ab4-115f-483c-bc4a-7e659b746bed" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:45:32 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-13db3951-6ba2-4410-a87b-e37635dde575 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Lock "cinder-quobyte-ef2d3ab4-115f-483c-bc4a-7e659b746bed" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:45:32 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-13db3951-6ba2-4410-a87b-e37635dde575 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Deleting offline snapshot ef2d3ab4-115f-483c-bc4a-7e659b746bed of volume 0f35a2a5-ada7-4aea-9ef4-d67b555d9336 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 19:45:32 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-13db3951-6ba2-4410-a87b-e37635dde575 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] snapshot_file for this snap is: volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336.ef2d3ab4-115f-483c-bc4a-7e659b746bed {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 19:45:32 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[c253a0fb-603e-4ac5-bc53-a87c98461f68]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:45:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-13db3951-6ba2-4410-a87b-e37635dde575 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336.ef2d3ab4-115f-483c-bc4a-7e659b746bed {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:32 devstack sudo[91964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336.ef2d3ab4-115f-483c-bc4a-7e659b746bed Sep 10 19:45:32 devstack sudo[91964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:33 devstack sudo[91964]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-13db3951-6ba2-4410-a87b-e37635dde575 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336.ef2d3ab4-115f-483c-bc4a-7e659b746bed" returned: 0 in 0.696s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:33 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-13db3951-6ba2-4410-a87b-e37635dde575 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:45:33 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9be5db8-a8cb-4ba1-8b94-052055ea5176]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:45:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-13db3951-6ba2-4410-a87b-e37635dde575 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:33 devstack sudo[91970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336 Sep 10 19:45:33 devstack sudo[91970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:33 devstack sudo[91970]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-13db3951-6ba2-4410-a87b-e37635dde575 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336" returned: 0 in 0.522s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-13db3951-6ba2-4410-a87b-e37635dde575 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336.ef2d3ab4-115f-483c-bc4a-7e659b746bed {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:33 devstack sudo[91977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336.ef2d3ab4-115f-483c-bc4a-7e659b746bed Sep 10 19:45:33 devstack sudo[91977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:34 devstack sudo[91977]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-13db3951-6ba2-4410-a87b-e37635dde575 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336.ef2d3ab4-115f-483c-bc4a-7e659b746bed" returned: 0 in 0.537s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-13db3951-6ba2-4410-a87b-e37635dde575 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336.ef2d3ab4-115f-483c-bc4a-7e659b746bed {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:34 devstack sudo[91983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336.ef2d3ab4-115f-483c-bc4a-7e659b746bed Sep 10 19:45:34 devstack sudo[91983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:34 devstack sudo[91983]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-13db3951-6ba2-4410-a87b-e37635dde575 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336.ef2d3ab4-115f-483c-bc4a-7e659b746bed" returned: 0 in 0.440s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:34 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-13db3951-6ba2-4410-a87b-e37635dde575 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Lock "cinder-quobyte-ef2d3ab4-115f-483c-bc4a-7e659b746bed" released by "_delete_snapshot" :: held 2.351s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:45:34 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-13db3951-6ba2-4410-a87b-e37635dde575 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Lock "cinder-quobyte-0f35a2a5-ada7-4aea-9ef4-d67b555d9336" released by "delete_snapshot" :: held 2.390s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:45:34 devstack cinder-volume[88093]: WARNING cinder.quota [None req-13db3951-6ba2-4410-a87b-e37635dde575 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:45:34 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-13db3951-6ba2-4410-a87b-e37635dde575 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Created reservations ['3f671f0c-4300-4c86-940e-4eea48cee373', 'f28f96c6-b517-4468-91ea-b75e8de9628a', '9246c5c8-e9c6-4f74-ba80-d356a81b20fd', 'd7823237-1b52-499f-a447-f852ed0791c4'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:45:34 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-13db3951-6ba2-4410-a87b-e37635dde575 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Delete snapshot completed successfully. Sep 10 19:45:34 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-13db3951-6ba2-4410-a87b-e37635dde575 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Lock "cinder-ef2d3ab4-115f-483c-bc4a-7e659b746bed-delete_snapshot" released by "delete_snapshot" :: held 2.569s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:45:35 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-8a46ea18-74c8-4afe-b641-ee380d339fd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Acquiring lock "cinder-0f35a2a5-ada7-4aea-9ef4-d67b555d9336-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:45:35 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-8a46ea18-74c8-4afe-b641-ee380d339fd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Lock "cinder-0f35a2a5-ada7-4aea-9ef4-d67b555d9336-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:45:35 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-8a46ea18-74c8-4afe-b641-ee380d339fd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Acquiring lock "cinder-quobyte-0f35a2a5-ada7-4aea-9ef4-d67b555d9336" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:45:35 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-8a46ea18-74c8-4afe-b641-ee380d339fd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Lock "cinder-quobyte-0f35a2a5-ada7-4aea-9ef4-d67b555d9336" acquired by "delete_volume" :: waited 0.024s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:45:35 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbeea2e-85c6-4bd7-804d-614bbd0cde3d]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:45:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8a46ea18-74c8-4afe-b641-ee380d339fd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:35 devstack sudo[91988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336 Sep 10 19:45:35 devstack sudo[91988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:36 devstack sudo[91988]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8a46ea18-74c8-4afe-b641-ee380d339fd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336" returned: 0 in 0.444s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8a46ea18-74c8-4afe-b641-ee380d339fd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:36 devstack sudo[91993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336 Sep 10 19:45:36 devstack sudo[91993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:36 devstack sudo[91993]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8a46ea18-74c8-4afe-b641-ee380d339fd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0f35a2a5-ada7-4aea-9ef4-d67b555d9336" returned: 0 in 0.276s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:36 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-8a46ea18-74c8-4afe-b641-ee380d339fd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Lock "cinder-quobyte-0f35a2a5-ada7-4aea-9ef4-d67b555d9336" released by "delete_volume" :: held 0.794s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:45:36 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-8a46ea18-74c8-4afe-b641-ee380d339fd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Created reservations ['025b54a2-f9eb-4067-b4c3-db1db2ddaf82', 'f5b45196-9dbe-4830-a261-f9b966d3d60d', '3efe5a0c-f219-4222-9453-5ed813c78e98', 'ea79b529-e5c4-49c1-88e8-5bf41dec2227'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:45:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-8a46ea18-74c8-4afe-b641-ee380d339fd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:45:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-8a46ea18-74c8-4afe-b641-ee380d339fd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:45:36 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-8a46ea18-74c8-4afe-b641-ee380d339fd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:45:36 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-8a46ea18-74c8-4afe-b641-ee380d339fd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:45:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-8a46ea18-74c8-4afe-b641-ee380d339fd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:45:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8a46ea18-74c8-4afe-b641-ee380d339fd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:36 devstack sudo[91996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:45:36 devstack sudo[91996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:37 devstack sudo[91996]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8a46ea18-74c8-4afe-b641-ee380d339fd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.599s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:37 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-8a46ea18-74c8-4afe-b641-ee380d339fd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:45:37 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-8a46ea18-74c8-4afe-b641-ee380d339fd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Deleted volume successfully. Sep 10 19:45:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-8a46ea18-74c8-4afe-b641-ee380d339fd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018982277 None] Lock "cinder-0f35a2a5-ada7-4aea-9ef4-d67b555d9336-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:45:37 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-f76cdbfe-6238-4eff-b627-8b1c7ccea9bb req-3c344eba-17f3-4b12-8799-1e73ccb838b8 tempest-ServerActionsTestOtherA-1390177495 None] Terminate volume connection completed successfully. Sep 10 19:45:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-f76cdbfe-6238-4eff-b627-8b1c7ccea9bb req-3c344eba-17f3-4b12-8799-1e73ccb838b8 tempest-ServerActionsTestOtherA-1390177495 None] Deleting attachment 6afbc2dd-2bb0-447e-8842-d3b65f3a60e9. {{(pid=88093) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 19:45:47 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:45:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Flow 'volume_create_manager' (f8948d12-bc84-4fba-bf9d-4b2c4cd56eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:45:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f94477a-cabd-405b-b566-55235a9429ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:45:47 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:UPDATE=21,cinder:SELECT=16,cinder:INSERT=6,cinder:DELETE=1 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:45:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f94477a-cabd-405b-b566-55235a9429ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1832705339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=342a6110-8faa-4351-a820-92326f101bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='351795e2277c4c33a0f850111b40b35d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:45:48Z,use_quota=True,user_id='08037bc85f244499b81d879ecdb62e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:45:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f04245f2-b3f0-47e2-829d-942f44ec7bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:45:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f04245f2-b3f0-47e2-829d-942f44ec7bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:45:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89aa275-49d7-4ff7-ba0d-9f1fd9543a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:45:47 devstack cinder-volume[88093]: DEBUG cinder.image.glance [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Creating Keystone auth plugin from conf {{(pid=88093) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 19:45:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89aa275-49d7-4ff7-ba0d-9f1fd9543a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '342a6110-8faa-4351-a820-92326f101bf5', 'volume_name': 'volume-342a6110-8faa-4351-a820-92326f101bf5', 'volume_size': 1, 'image_id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cce253731714c6797a2e9bce91009cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'created_at': datetime.datetime(2026, 9, 10, 17, 35, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 35, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:45:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e755ba0b-fcf2-4cd9-88f6-e7b8a44871a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:45:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e755ba0b-fcf2-4cd9-88f6-e7b8a44871a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:45:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73261ada-8aff-4c29-90ae-118cc6334489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:45:48 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Volume 342a6110-8faa-4351-a820-92326f101bf5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-342a6110-8faa-4351-a820-92326f101bf5', 'volume_size': 1, 'image_id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cce253731714c6797a2e9bce91009cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'created_at': datetime.datetime(2026, 9, 10, 17, 35, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 35, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 19:45:48 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Trying to clone 342a6110-8faa-4351-a820-92326f101bf5 from image ce7b5bdf-521a-42b1-b62b-e8406ccf342b at location (None, [{'url': 'file:///opt/stack/data/glance/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'metadata': {}}]). {{(pid=88093) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 19:45:48 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_o94bapffdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88093) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 19:45:48 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Image download 20.69 MB at 20.69 MB/s Sep 10 19:45:48 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fca3bdf-344c-4ffb-9dbc-99848bac1ba5]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:45:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_o94bapffdevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:48 devstack sudo[92151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_o94bapffdevstack@QuobyteHD Sep 10 19:45:48 devstack sudo[92151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:49 devstack sudo[92151]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_o94bapffdevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:49 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Temporary image ce7b5bdf-521a-42b1-b62b-e8406ccf342b is fetched for user 08037bc85f244499b81d879ecdb62e0e. {{(pid=88093) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 19:45:49 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[50eb81a9-abab-47dc-b821-cad64cdfb45c]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:45:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_o94bapffdevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:49 devstack sudo[92157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_o94bapffdevstack@QuobyteHD Sep 10 19:45:49 devstack sudo[92157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:49 devstack sudo[92157]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_o94bapffdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:45:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:45:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1832705339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=342a6110-8faa-4351-a820-92326f101bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='351795e2277c4c33a0f850111b40b35d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:45:48Z,use_quota=True,user_id='08037bc85f244499b81d879ecdb62e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:45:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Creating volume 342a6110-8faa-4351-a820-92326f101bf5 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:45:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:45:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:45:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:45:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:45:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:45:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:45:49 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:45:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-342a6110-8faa-4351-a820-92326f101bf5 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:49 devstack sudo[92162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-342a6110-8faa-4351-a820-92326f101bf5 1073741824 Sep 10 19:45:49 devstack sudo[92162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:50 devstack sudo[92162]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-342a6110-8faa-4351-a820-92326f101bf5 1073741824" returned: 0 in 0.490s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-342a6110-8faa-4351-a820-92326f101bf5 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:50 devstack sudo[92168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-342a6110-8faa-4351-a820-92326f101bf5 Sep 10 19:45:50 devstack sudo[92168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:50 devstack sudo[92168]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-342a6110-8faa-4351-a820-92326f101bf5" returned: 0 in 0.290s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:50 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:45:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:45:50 devstack cinder-volume[88093]: DEBUG cinder.volume.volume_utils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Attempting download of ce7b5bdf-521a-42b1-b62b-e8406ccf342b ((None, [{'url': 'file:///opt/stack/data/glance/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'metadata': {}}])) to volume 342a6110-8faa-4351-a820-92326f101bf5. {{(pid=88093) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 19:45:50 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4ad286-ca72-47e0-bfc8-af1ec030e0ca]: (4, 'raw') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:45:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_7tf76d0z {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:50 devstack sudo[92171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_7tf76d0z Sep 10 19:45:50 devstack sudo[92171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:51 devstack sudo[92171]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_7tf76d0z" returned: 0 in 0.466s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_7tf76d0z {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:51 devstack sudo[92175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_7tf76d0z Sep 10 19:45:51 devstack sudo[92175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:51 devstack sudo[92175]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_7tf76d0z" returned: 1 in 0.392s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_7tf76d0z' failed. Not Retrying. {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 19:45:51 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfa7801-3421-4549-a040-5a713ae39d1e]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:45:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_o94bapffdevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:51 devstack sudo[92179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_o94bapffdevstack@QuobyteHD Sep 10 19:45:51 devstack sudo[92179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:51 devstack sudo[92179]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_o94bapffdevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:51 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] ce7b5bdf-521a-42b1-b62b-e8406ccf342b was qcow2, converting to qcow2 {{(pid=88093) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 19:45:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_o94bapffdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-342a6110-8faa-4351-a820-92326f101bf5 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:51 devstack sudo[92184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_o94bapffdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-342a6110-8faa-4351-a820-92326f101bf5 Sep 10 19:45:51 devstack sudo[92184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:53 devstack sudo[92184]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_o94bapffdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-342a6110-8faa-4351-a820-92326f101bf5" returned: 0 in 2.005s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:53 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_o94bapffdevstack@QuobyteHD, size 112.00 MB, duration 2.01 sec, destination /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-342a6110-8faa-4351-a820-92326f101bf5 {{(pid=88093) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 19:45:53 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Converted 112.00 MB image at 55.81 MB/s Sep 10 19:45:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-342a6110-8faa-4351-a820-92326f101bf5 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:53 devstack sudo[92197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-342a6110-8faa-4351-a820-92326f101bf5 1G Sep 10 19:45:53 devstack sudo[92197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:54 devstack sudo[92197]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-342a6110-8faa-4351-a820-92326f101bf5 1G" returned: 0 in 0.400s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG cinder.volume.volume_utils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Downloaded image ce7b5bdf-521a-42b1-b62b-e8406ccf342b ((None, [{'url': 'file:///opt/stack/data/glance/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'metadata': {}}])) to volume 342a6110-8faa-4351-a820-92326f101bf5 successfully. {{(pid=88093) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Temporary image ce7b5bdf-521a-42b1-b62b-e8406ccf342b for user 08037bc85f244499b81d879ecdb62e0e is deleted. {{(pid=88093) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG cinder.volume.volume_utils [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Marking volume 342a6110-8faa-4351-a820-92326f101bf5 as bootable. {{(pid=88093) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Copying metadata from image ce7b5bdf-521a-42b1-b62b-e8406ccf342b to 342a6110-8faa-4351-a820-92326f101bf5. {{(pid=88093) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Creating volume glance metadata for volume 342a6110-8faa-4351-a820-92326f101bf5 backed by image ce7b5bdf-521a-42b1-b62b-e8406ccf342b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88093) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] Flow 'volume_create_manager' (98dc474a-15c2-492c-9b74-3e30c4ff298e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba83a84d-0605-43bf-8821-1fa6ad93e26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba83a84d-0605-43bf-8821-1fa6ad93e26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-383277545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24cb6b95-1e0d-4a89-a5a6-a6e17cbda4e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7daf268f110e4c5dbf2a7d2bb641dbef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:45:54Z,use_quota=True,user_id='f5c9c26053e94b94a2136c037098428b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (792715e2-6def-442f-ace5-df3018969b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (792715e2-6def-442f-ace5-df3018969b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0afa51-e5ae-4b5b-ad2e-89a5c4ea0128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0afa51-e5ae-4b5b-ad2e-89a5c4ea0128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24cb6b95-1e0d-4a89-a5a6-a6e17cbda4e6', 'volume_name': 'volume-24cb6b95-1e0d-4a89-a5a6-a6e17cbda4e6', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37bf83b-9b75-40f0-b73d-964907f38355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37bf83b-9b75-40f0-b73d-964907f38355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27655c60-b349-4627-8522-40bc7653fac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:45:54 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] Volume 24cb6b95-1e0d-4a89-a5a6-a6e17cbda4e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24cb6b95-1e0d-4a89-a5a6-a6e17cbda4e6', 'volume_size': 1} Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-383277545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24cb6b95-1e0d-4a89-a5a6-a6e17cbda4e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7daf268f110e4c5dbf2a7d2bb641dbef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:45:54Z,use_quota=True,user_id='f5c9c26053e94b94a2136c037098428b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] Creating volume 24cb6b95-1e0d-4a89-a5a6-a6e17cbda4e6 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:45:54 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-24cb6b95-1e0d-4a89-a5a6-a6e17cbda4e6 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73261ada-8aff-4c29-90ae-118cc6334489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-342a6110-8faa-4351-a820-92326f101bf5', 'volume_size': 1, 'image_id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cce253731714c6797a2e9bce91009cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'created_at': datetime.datetime(2026, 9, 10, 17, 35, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 35, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e7483c-8fb2-4348-9366-23ff598abe0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:45:54 devstack sudo[92203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-24cb6b95-1e0d-4a89-a5a6-a6e17cbda4e6 1073741824 Sep 10 19:45:54 devstack sudo[92203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:54 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Volume volume-342a6110-8faa-4351-a820-92326f101bf5 (342a6110-8faa-4351-a820-92326f101bf5): created successfully Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e7483c-8fb2-4348-9366-23ff598abe0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:45:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Flow 'volume_create_manager' (f8948d12-bc84-4fba-bf9d-4b2c4cd56eeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:45:54 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-d229b1cc-d29e-4f08-b1a3-f06d6425f2cb tempest-ServerActionsTestOtherA-1390177495 None] Created volume successfully. Sep 10 19:45:55 devstack sudo[92203]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-24cb6b95-1e0d-4a89-a5a6-a6e17cbda4e6 1073741824" returned: 0 in 0.450s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-24cb6b95-1e0d-4a89-a5a6-a6e17cbda4e6 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:45:55 devstack sudo[92208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-24cb6b95-1e0d-4a89-a5a6-a6e17cbda4e6 Sep 10 19:45:55 devstack sudo[92208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:45:55 devstack sudo[92208]: pam_unix(sudo:session): session closed for user root Sep 10 19:45:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-24cb6b95-1e0d-4a89-a5a6-a6e17cbda4e6" returned: 0 in 0.322s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:45:55 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:45:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:45:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27655c60-b349-4627-8522-40bc7653fac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24cb6b95-1e0d-4a89-a5a6-a6e17cbda4e6', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:45:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e280f8-8144-487e-9c61-0f9cbb346d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:45:55 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] Volume volume-24cb6b95-1e0d-4a89-a5a6-a6e17cbda4e6 (24cb6b95-1e0d-4a89-a5a6-a6e17cbda4e6): created successfully Sep 10 19:45:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e280f8-8144-487e-9c61-0f9cbb346d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:45:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] Flow 'volume_create_manager' (98dc474a-15c2-492c-9b74-3e30c4ff298e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:45:55 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-7b6348cb-ad63-4822-987b-25bea16ef784 tempest-AttachVolumeNegativeTest-2048411806 None] Created volume successfully. Sep 10 19:45:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-c1652ef3-9e88-4d32-a25f-4ba860db0e2f req-d50ca5f4-bc1c-40aa-a32d-ff920185b896 tempest-AttachVolumeNegativeTest-2048411806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:45:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-c1652ef3-9e88-4d32-a25f-4ba860db0e2f req-d50ca5f4-bc1c-40aa-a32d-ff920185b896 tempest-AttachVolumeNegativeTest-2048411806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:45:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-c1652ef3-9e88-4d32-a25f-4ba860db0e2f req-d50ca5f4-bc1c-40aa-a32d-ff920185b896 tempest-AttachVolumeNegativeTest-2048411806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:45:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-c1652ef3-9e88-4d32-a25f-4ba860db0e2f req-d50ca5f4-bc1c-40aa-a32d-ff920185b896 tempest-AttachVolumeNegativeTest-2048411806 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3', 'name': 'volume-24cb6b95-1e0d-4a89-a5a6-a6e17cbda4e6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e6946ae3-0e69-4c1a-9a1d-5cbffc39f1ec', 'enforce_multipath': True} {{(pid=88093) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 19:45:57 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-c1652ef3-9e88-4d32-a25f-4ba860db0e2f req-d50ca5f4-bc1c-40aa-a32d-ff920185b896 tempest-AttachVolumeNegativeTest-2048411806 None] attachment_update completed successfully. Sep 10 19:45:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-2a5cf85b-ff63-4658-b839-5a79923fd76b req-b8bc8c10-77ea-4f00-a9a3-c1202b982d10 tempest-ServerActionsTestOtherA-1390177495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:45:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-2a5cf85b-ff63-4658-b839-5a79923fd76b req-b8bc8c10-77ea-4f00-a9a3-c1202b982d10 tempest-ServerActionsTestOtherA-1390177495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:45:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-2a5cf85b-ff63-4658-b839-5a79923fd76b req-b8bc8c10-77ea-4f00-a9a3-c1202b982d10 tempest-ServerActionsTestOtherA-1390177495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:45:58 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-2a5cf85b-ff63-4658-b839-5a79923fd76b req-b8bc8c10-77ea-4f00-a9a3-c1202b982d10 tempest-ServerActionsTestOtherA-1390177495 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3', 'name': 'volume-342a6110-8faa-4351-a820-92326f101bf5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2584ff55-1a5a-4a51-876f-c398b59a6128', 'enforce_multipath': True} {{(pid=88093) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 19:45:58 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-2a5cf85b-ff63-4658-b839-5a79923fd76b req-b8bc8c10-77ea-4f00-a9a3-c1202b982d10 tempest-ServerActionsTestOtherA-1390177495 None] attachment_update completed successfully. Sep 10 19:46:03 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:46:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:46:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:46:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:46:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:46:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:46:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:03 devstack sudo[92662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:46:03 devstack sudo[92662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:04 devstack sudo[92662]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.462s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:04 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:46:04 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager._thread_info {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:46:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread count: 28 {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 19:46:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread info: [<_MainThread(MainThread, started 138417491665024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 19:46:05 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:46:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] Flow 'volume_create_manager' (746e9d0f-d068-44ea-bb2a-f477537abd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:46:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c9e7341-d896-4894-ade5-d84cc393a740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:46:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c9e7341-d896-4894-ade5-d84cc393a740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1376013946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5869e431-d876-44b3-b64d-7202d71536ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fa3297182274b28ab135d1d8f378ef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:46:06Z,use_quota=True,user_id='241908954322428da101f68b80249edb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:46:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcbd1e3a-96bf-47d7-9c1b-5f223f6eb0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:46:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcbd1e3a-96bf-47d7-9c1b-5f223f6eb0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:46:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274243f7-5985-4592-a394-b369b25cd41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:46:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274243f7-5985-4592-a394-b369b25cd41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5869e431-d876-44b3-b64d-7202d71536ca', 'volume_name': 'volume-5869e431-d876-44b3-b64d-7202d71536ca', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:46:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7209c60f-b4f5-4fb0-af29-5b5a2eac64c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:46:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7209c60f-b4f5-4fb0-af29-5b5a2eac64c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:46:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5379be8-b6fb-48d4-b4dc-ad4829a03f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:46:05 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] Volume 5869e431-d876-44b3-b64d-7202d71536ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5869e431-d876-44b3-b64d-7202d71536ca', 'volume_size': 1} Sep 10 19:46:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:46:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:46:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1376013946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5869e431-d876-44b3-b64d-7202d71536ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fa3297182274b28ab135d1d8f378ef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:46:06Z,use_quota=True,user_id='241908954322428da101f68b80249edb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:46:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] Creating volume 5869e431-d876-44b3-b64d-7202d71536ca {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:46:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:46:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:46:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:46:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:46:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:46:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:46:05 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:46:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:05 devstack sudo[92675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca 1073741824 Sep 10 19:46:05 devstack sudo[92675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:06 devstack sudo[92675]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca 1073741824" returned: 0 in 0.658s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:06 devstack sudo[92684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca Sep 10 19:46:06 devstack sudo[92684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:07 devstack sudo[92684]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca" returned: 0 in 0.539s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:46:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:46:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5379be8-b6fb-48d4-b4dc-ad4829a03f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5869e431-d876-44b3-b64d-7202d71536ca', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:46:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca70fa34-fb04-44ab-9da0-e685f1a0501d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:46:07 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] Volume volume-5869e431-d876-44b3-b64d-7202d71536ca (5869e431-d876-44b3-b64d-7202d71536ca): created successfully Sep 10 19:46:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca70fa34-fb04-44ab-9da0-e685f1a0501d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:46:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] Flow 'volume_create_manager' (746e9d0f-d068-44ea-bb2a-f477537abd2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:46:07 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-689a9bc1-8c04-47a7-b523-f1a904bb15d7 tempest-SnapshotMetadataTestJSON-709425189 None] Created volume successfully. Sep 10 19:46:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-24755f20-6436-42a7-b00f-15349709e13d tempest-SnapshotMetadataTestJSON-709425189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:46:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-24755f20-6436-42a7-b00f-15349709e13d tempest-SnapshotMetadataTestJSON-709425189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:46:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-24755f20-6436-42a7-b00f-15349709e13d tempest-SnapshotMetadataTestJSON-709425189 None] Creating offline snapshot 2811d825-3ab1-4ede-adc2-f71b610fd0f6 of volume 5869e431-d876-44b3-b64d-7202d71536ca {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 19:46:08 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[089948e8-abda-4af7-adb7-14ab159ddc8e]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:46:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-24755f20-6436-42a7-b00f-15349709e13d tempest-SnapshotMetadataTestJSON-709425189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:08 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca Sep 10 19:46:08 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:08 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-24755f20-6436-42a7-b00f-15349709e13d tempest-SnapshotMetadataTestJSON-709425189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca" returned: 0 in 0.568s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-24755f20-6436-42a7-b00f-15349709e13d tempest-SnapshotMetadataTestJSON-709425189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca.2811d825-3ab1-4ede-adc2-f71b610fd0f6 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:09 devstack sudo[92711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca.2811d825-3ab1-4ede-adc2-f71b610fd0f6 1G Sep 10 19:46:09 devstack sudo[92711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:09 devstack sudo[92711]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-24755f20-6436-42a7-b00f-15349709e13d tempest-SnapshotMetadataTestJSON-709425189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca.2811d825-3ab1-4ede-adc2-f71b610fd0f6 1G" returned: 0 in 0.791s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-24755f20-6436-42a7-b00f-15349709e13d tempest-SnapshotMetadataTestJSON-709425189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5869e431-d876-44b3-b64d-7202d71536ca -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca.2811d825-3ab1-4ede-adc2-f71b610fd0f6 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:09 devstack sudo[92719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5869e431-d876-44b3-b64d-7202d71536ca -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca.2811d825-3ab1-4ede-adc2-f71b610fd0f6 Sep 10 19:46:09 devstack sudo[92719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:10 devstack sudo[92719]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-24755f20-6436-42a7-b00f-15349709e13d tempest-SnapshotMetadataTestJSON-709425189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5869e431-d876-44b3-b64d-7202d71536ca -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca.2811d825-3ab1-4ede-adc2-f71b610fd0f6" returned: 0 in 0.467s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:10 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-24755f20-6436-42a7-b00f-15349709e13d tempest-SnapshotMetadataTestJSON-709425189 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca.2811d825-3ab1-4ede-adc2-f71b610fd0f6 is being set with open permissions: ugo+rw Sep 10 19:46:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-24755f20-6436-42a7-b00f-15349709e13d tempest-SnapshotMetadataTestJSON-709425189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca.2811d825-3ab1-4ede-adc2-f71b610fd0f6 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:10 devstack sudo[92728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca.2811d825-3ab1-4ede-adc2-f71b610fd0f6 Sep 10 19:46:10 devstack sudo[92728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:10 devstack sudo[92728]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-24755f20-6436-42a7-b00f-15349709e13d tempest-SnapshotMetadataTestJSON-709425189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca.2811d825-3ab1-4ede-adc2-f71b610fd0f6" returned: 0 in 0.513s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-24755f20-6436-42a7-b00f-15349709e13d tempest-SnapshotMetadataTestJSON-709425189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:10 devstack sudo[92733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca.info Sep 10 19:46:10 devstack sudo[92733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:11 devstack sudo[92733]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-24755f20-6436-42a7-b00f-15349709e13d tempest-SnapshotMetadataTestJSON-709425189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca.info" returned: 0 in 0.402s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:11 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-24755f20-6436-42a7-b00f-15349709e13d tempest-SnapshotMetadataTestJSON-709425189 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca.info is being set with open permissions: ugo+rw Sep 10 19:46:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-24755f20-6436-42a7-b00f-15349709e13d tempest-SnapshotMetadataTestJSON-709425189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:11 devstack sudo[92736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca.info Sep 10 19:46:11 devstack sudo[92736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:12 devstack sudo[92736]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-24755f20-6436-42a7-b00f-15349709e13d tempest-SnapshotMetadataTestJSON-709425189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca.info" returned: 0 in 0.849s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-24755f20-6436-42a7-b00f-15349709e13d tempest-SnapshotMetadataTestJSON-709425189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.758s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:46:12 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-24755f20-6436-42a7-b00f-15349709e13d tempest-SnapshotMetadataTestJSON-709425189 None] Create snapshot completed successfully Sep 10 19:46:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9cdebeb8-f9e8-4115-a110-d59114ea40f8 tempest-SnapshotMetadataTestJSON-709425189 None] Acquiring lock "cinder-2811d825-3ab1-4ede-adc2-f71b610fd0f6-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:46:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9cdebeb8-f9e8-4115-a110-d59114ea40f8 tempest-SnapshotMetadataTestJSON-709425189 None] Lock "cinder-2811d825-3ab1-4ede-adc2-f71b610fd0f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:46:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9cdebeb8-f9e8-4115-a110-d59114ea40f8 tempest-SnapshotMetadataTestJSON-709425189 None] Acquiring lock "cinder-quobyte-5869e431-d876-44b3-b64d-7202d71536ca" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:46:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9cdebeb8-f9e8-4115-a110-d59114ea40f8 tempest-SnapshotMetadataTestJSON-709425189 None] Lock "cinder-quobyte-5869e431-d876-44b3-b64d-7202d71536ca" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:46:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9cdebeb8-f9e8-4115-a110-d59114ea40f8 tempest-SnapshotMetadataTestJSON-709425189 None] Acquiring lock "cinder-quobyte-2811d825-3ab1-4ede-adc2-f71b610fd0f6" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:46:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9cdebeb8-f9e8-4115-a110-d59114ea40f8 tempest-SnapshotMetadataTestJSON-709425189 None] Lock "cinder-quobyte-2811d825-3ab1-4ede-adc2-f71b610fd0f6" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:46:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-9cdebeb8-f9e8-4115-a110-d59114ea40f8 tempest-SnapshotMetadataTestJSON-709425189 None] Deleting offline snapshot 2811d825-3ab1-4ede-adc2-f71b610fd0f6 of volume 5869e431-d876-44b3-b64d-7202d71536ca {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 19:46:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-9cdebeb8-f9e8-4115-a110-d59114ea40f8 tempest-SnapshotMetadataTestJSON-709425189 None] snapshot_file for this snap is: volume-5869e431-d876-44b3-b64d-7202d71536ca.2811d825-3ab1-4ede-adc2-f71b610fd0f6 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 19:46:14 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ad63f5-4fa2-40d2-8735-521f41b63193]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:46:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9cdebeb8-f9e8-4115-a110-d59114ea40f8 tempest-SnapshotMetadataTestJSON-709425189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca.2811d825-3ab1-4ede-adc2-f71b610fd0f6 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:14 devstack sudo[92784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca.2811d825-3ab1-4ede-adc2-f71b610fd0f6 Sep 10 19:46:14 devstack sudo[92784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:15 devstack sudo[92784]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9cdebeb8-f9e8-4115-a110-d59114ea40f8 tempest-SnapshotMetadataTestJSON-709425189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca.2811d825-3ab1-4ede-adc2-f71b610fd0f6" returned: 0 in 0.643s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:15 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-9cdebeb8-f9e8-4115-a110-d59114ea40f8 tempest-SnapshotMetadataTestJSON-709425189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5869e431-d876-44b3-b64d-7202d71536ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:46:15 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4af74d7-bd23-4091-859c-22ed9ae1e84c]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:46:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9cdebeb8-f9e8-4115-a110-d59114ea40f8 tempest-SnapshotMetadataTestJSON-709425189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:15 devstack sudo[92792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca Sep 10 19:46:15 devstack sudo[92792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:16 devstack sudo[92792]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9cdebeb8-f9e8-4115-a110-d59114ea40f8 tempest-SnapshotMetadataTestJSON-709425189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca" returned: 0 in 1.046s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9cdebeb8-f9e8-4115-a110-d59114ea40f8 tempest-SnapshotMetadataTestJSON-709425189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca.2811d825-3ab1-4ede-adc2-f71b610fd0f6 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:16 devstack sudo[92803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca.2811d825-3ab1-4ede-adc2-f71b610fd0f6 Sep 10 19:46:16 devstack sudo[92803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:17 devstack sudo[92803]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9cdebeb8-f9e8-4115-a110-d59114ea40f8 tempest-SnapshotMetadataTestJSON-709425189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca.2811d825-3ab1-4ede-adc2-f71b610fd0f6" returned: 0 in 1.134s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9cdebeb8-f9e8-4115-a110-d59114ea40f8 tempest-SnapshotMetadataTestJSON-709425189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca.2811d825-3ab1-4ede-adc2-f71b610fd0f6 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:17 devstack sudo[92837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca.2811d825-3ab1-4ede-adc2-f71b610fd0f6 Sep 10 19:46:17 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:18 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9cdebeb8-f9e8-4115-a110-d59114ea40f8 tempest-SnapshotMetadataTestJSON-709425189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca.2811d825-3ab1-4ede-adc2-f71b610fd0f6" returned: 0 in 0.809s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:18 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9cdebeb8-f9e8-4115-a110-d59114ea40f8 tempest-SnapshotMetadataTestJSON-709425189 None] Lock "cinder-quobyte-2811d825-3ab1-4ede-adc2-f71b610fd0f6" released by "_delete_snapshot" :: held 3.993s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:46:18 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9cdebeb8-f9e8-4115-a110-d59114ea40f8 tempest-SnapshotMetadataTestJSON-709425189 None] Lock "cinder-quobyte-5869e431-d876-44b3-b64d-7202d71536ca" released by "delete_snapshot" :: held 4.051s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:46:18 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-9cdebeb8-f9e8-4115-a110-d59114ea40f8 tempest-SnapshotMetadataTestJSON-709425189 None] Created reservations ['acb4deea-dcdd-4585-a0da-17e6924ad430', 'c24de1bc-933b-4f0c-bd83-0d29f3c87913', '0febe6d6-3b0d-4913-b5ce-768817d3f7be', 'f35840de-a3ca-48b3-9d3b-97fe481a56f1'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:46:18 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-9cdebeb8-f9e8-4115-a110-d59114ea40f8 tempest-SnapshotMetadataTestJSON-709425189 None] Delete snapshot completed successfully. Sep 10 19:46:18 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9cdebeb8-f9e8-4115-a110-d59114ea40f8 tempest-SnapshotMetadataTestJSON-709425189 None] Lock "cinder-2811d825-3ab1-4ede-adc2-f71b610fd0f6-delete_snapshot" released by "delete_snapshot" :: held 4.429s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:46:20 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-502fc232-81f8-4c13-9d18-c4e235e71ece tempest-SnapshotMetadataTestJSON-709425189 None] Acquiring lock "cinder-5869e431-d876-44b3-b64d-7202d71536ca-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:46:20 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-502fc232-81f8-4c13-9d18-c4e235e71ece tempest-SnapshotMetadataTestJSON-709425189 None] Lock "cinder-5869e431-d876-44b3-b64d-7202d71536ca-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:46:20 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=52,cinder:UPDATE=41,cinder:INSERT=16,cinder:DELETE=4 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:46:20 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-502fc232-81f8-4c13-9d18-c4e235e71ece tempest-SnapshotMetadataTestJSON-709425189 None] Acquiring lock "cinder-quobyte-5869e431-d876-44b3-b64d-7202d71536ca" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:46:20 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-502fc232-81f8-4c13-9d18-c4e235e71ece tempest-SnapshotMetadataTestJSON-709425189 None] Lock "cinder-quobyte-5869e431-d876-44b3-b64d-7202d71536ca" acquired by "delete_volume" :: waited 0.059s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:46:20 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1730b68-1ad9-41b9-999b-ef288bebcf06]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:46:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-502fc232-81f8-4c13-9d18-c4e235e71ece tempest-SnapshotMetadataTestJSON-709425189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:20 devstack sudo[92900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca Sep 10 19:46:20 devstack sudo[92900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-053bea01-40d7-41e6-b71d-c208d6ad56a9 req-0ec569b3-53cd-49cb-8745-1768dcf1afec tempest-TaggedAttachmentsTest-369772138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:46:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-053bea01-40d7-41e6-b71d-c208d6ad56a9 req-0ec569b3-53cd-49cb-8745-1768dcf1afec tempest-TaggedAttachmentsTest-369772138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:46:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-053bea01-40d7-41e6-b71d-c208d6ad56a9 req-0ec569b3-53cd-49cb-8745-1768dcf1afec tempest-TaggedAttachmentsTest-369772138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:46:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-053bea01-40d7-41e6-b71d-c208d6ad56a9 req-0ec569b3-53cd-49cb-8745-1768dcf1afec tempest-TaggedAttachmentsTest-369772138 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3', 'name': 'volume-a7d34589-80df-45ac-b1f0-36e3d82be876', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '97e36d55-1285-4df2-a9bd-9e226c514632', 'enforce_multipath': True} {{(pid=88093) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 19:46:21 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-053bea01-40d7-41e6-b71d-c208d6ad56a9 req-0ec569b3-53cd-49cb-8745-1768dcf1afec tempest-TaggedAttachmentsTest-369772138 None] attachment_update completed successfully. Sep 10 19:46:21 devstack sudo[92900]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-502fc232-81f8-4c13-9d18-c4e235e71ece tempest-SnapshotMetadataTestJSON-709425189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca" returned: 0 in 0.789s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-502fc232-81f8-4c13-9d18-c4e235e71ece tempest-SnapshotMetadataTestJSON-709425189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:21 devstack sudo[92910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca Sep 10 19:46:21 devstack sudo[92910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:21 devstack sudo[92910]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-502fc232-81f8-4c13-9d18-c4e235e71ece tempest-SnapshotMetadataTestJSON-709425189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5869e431-d876-44b3-b64d-7202d71536ca" returned: 0 in 0.786s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:22 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-502fc232-81f8-4c13-9d18-c4e235e71ece tempest-SnapshotMetadataTestJSON-709425189 None] Lock "cinder-quobyte-5869e431-d876-44b3-b64d-7202d71536ca" released by "delete_volume" :: held 1.684s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:46:22 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-502fc232-81f8-4c13-9d18-c4e235e71ece tempest-SnapshotMetadataTestJSON-709425189 None] Created reservations ['91bcc4b0-3c0a-4b42-b901-d6496eeafc22', '1bbe9758-0adc-4dd4-a8a0-083397500ca8', '11a6cb2f-ce48-44ac-ace0-6dc3916a4a75', '8cac5d6d-c794-464b-bedc-e52e6ff27c79'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:46:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-502fc232-81f8-4c13-9d18-c4e235e71ece tempest-SnapshotMetadataTestJSON-709425189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:46:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-502fc232-81f8-4c13-9d18-c4e235e71ece tempest-SnapshotMetadataTestJSON-709425189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:46:22 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-502fc232-81f8-4c13-9d18-c4e235e71ece tempest-SnapshotMetadataTestJSON-709425189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:46:22 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-502fc232-81f8-4c13-9d18-c4e235e71ece tempest-SnapshotMetadataTestJSON-709425189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:46:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-502fc232-81f8-4c13-9d18-c4e235e71ece tempest-SnapshotMetadataTestJSON-709425189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:46:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-502fc232-81f8-4c13-9d18-c4e235e71ece tempest-SnapshotMetadataTestJSON-709425189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:22 devstack sudo[92963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:46:22 devstack sudo[92963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:22 devstack sudo[92963]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-502fc232-81f8-4c13-9d18-c4e235e71ece tempest-SnapshotMetadataTestJSON-709425189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.529s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:23 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-502fc232-81f8-4c13-9d18-c4e235e71ece tempest-SnapshotMetadataTestJSON-709425189 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:46:23 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-502fc232-81f8-4c13-9d18-c4e235e71ece tempest-SnapshotMetadataTestJSON-709425189 None] Deleted volume successfully. Sep 10 19:46:23 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-2b91ad1c-9e65-406b-bc7d-8219f2f29c2c req-d99194d6-5b64-4b52-9359-809c696bfa53 tempest-ServerActionsTestOtherA-1390177495 None] Terminate volume connection completed successfully. Sep 10 19:46:23 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-2b91ad1c-9e65-406b-bc7d-8219f2f29c2c req-d99194d6-5b64-4b52-9359-809c696bfa53 tempest-ServerActionsTestOtherA-1390177495 None] Deleting attachment 2584ff55-1a5a-4a51-876f-c398b59a6128. {{(pid=88093) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 19:46:23 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-502fc232-81f8-4c13-9d18-c4e235e71ece tempest-SnapshotMetadataTestJSON-709425189 None] Lock "cinder-5869e431-d876-44b3-b64d-7202d71536ca-delete_volume" released by "delete_volume" :: held 2.919s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:46:26 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-56a90b6a-7256-4503-bc3f-1a9e17eda37b req-3c0ed0fc-46e4-4ffa-9a41-74bf02b6b1dc tempest-TaggedAttachmentsTest-369772138 None] Terminate volume connection completed successfully. Sep 10 19:46:26 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-56a90b6a-7256-4503-bc3f-1a9e17eda37b req-3c0ed0fc-46e4-4ffa-9a41-74bf02b6b1dc tempest-TaggedAttachmentsTest-369772138 None] Deleting attachment 97e36d55-1285-4df2-a9bd-9e226c514632. {{(pid=88093) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 19:46:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-2b91ad1c-9e65-406b-bc7d-8219f2f29c2c req-c07e28ec-b820-432b-93b5-ec0151178964 tempest-ServerActionsTestOtherA-1390177495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:46:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-2b91ad1c-9e65-406b-bc7d-8219f2f29c2c req-c07e28ec-b820-432b-93b5-ec0151178964 tempest-ServerActionsTestOtherA-1390177495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:46:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-2b91ad1c-9e65-406b-bc7d-8219f2f29c2c req-c07e28ec-b820-432b-93b5-ec0151178964 tempest-ServerActionsTestOtherA-1390177495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:46:26 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-2b91ad1c-9e65-406b-bc7d-8219f2f29c2c req-c07e28ec-b820-432b-93b5-ec0151178964 tempest-ServerActionsTestOtherA-1390177495 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3', 'name': 'volume-342a6110-8faa-4351-a820-92326f101bf5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dc6f004c-6fbf-4942-865b-de16ad11db57', 'enforce_multipath': True} {{(pid=88093) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 19:46:26 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-2b91ad1c-9e65-406b-bc7d-8219f2f29c2c req-c07e28ec-b820-432b-93b5-ec0151178964 tempest-ServerActionsTestOtherA-1390177495 None] attachment_update completed successfully. Sep 10 19:46:32 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:46:32 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] Flow 'volume_create_manager' (6e155ec5-3691-4c66-81e3-7abfa6149ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:46:32 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902cf430-c967-4ce6-b02c-c6e3503c4d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:46:32 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902cf430-c967-4ce6-b02c-c6e3503c4d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1354812011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e09783c8-4ac9-4d54-ad7d-7510b64efd87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fefaaeb31f504d1b8dad9750b568dece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:46:32Z,use_quota=True,user_id='9c3ceb7ec6334dd38f06143e55cf5945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:46:32 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d3ae74-d92f-498b-8e05-a37967f631f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:46:32 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d3ae74-d92f-498b-8e05-a37967f631f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:46:32 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0feb0a62-ff86-4d94-bcae-4af95dafcce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:46:32 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0feb0a62-ff86-4d94-bcae-4af95dafcce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e09783c8-4ac9-4d54-ad7d-7510b64efd87', 'volume_name': 'volume-e09783c8-4ac9-4d54-ad7d-7510b64efd87', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:46:32 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80e17885-4ddb-4ef6-bb73-da6ceda2c575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:46:32 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80e17885-4ddb-4ef6-bb73-da6ceda2c575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:46:32 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b614df-c468-4a82-91c4-76cee4e9c500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:46:32 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] Volume e09783c8-4ac9-4d54-ad7d-7510b64efd87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e09783c8-4ac9-4d54-ad7d-7510b64efd87', 'volume_size': 1} Sep 10 19:46:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:46:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:46:32 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1354812011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e09783c8-4ac9-4d54-ad7d-7510b64efd87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fefaaeb31f504d1b8dad9750b568dece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:46:32Z,use_quota=True,user_id='9c3ceb7ec6334dd38f06143e55cf5945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:46:32 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] Creating volume e09783c8-4ac9-4d54-ad7d-7510b64efd87 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:46:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:46:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:46:32 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:46:32 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:46:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:46:32 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:46:32 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:46:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e09783c8-4ac9-4d54-ad7d-7510b64efd87 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:32 devstack sudo[93093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e09783c8-4ac9-4d54-ad7d-7510b64efd87 1073741824 Sep 10 19:46:32 devstack sudo[93093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:32 devstack sudo[93093]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e09783c8-4ac9-4d54-ad7d-7510b64efd87 1073741824" returned: 0 in 0.735s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e09783c8-4ac9-4d54-ad7d-7510b64efd87 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:33 devstack sudo[93100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e09783c8-4ac9-4d54-ad7d-7510b64efd87 Sep 10 19:46:33 devstack sudo[93100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:33 devstack sudo[93100]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e09783c8-4ac9-4d54-ad7d-7510b64efd87" returned: 0 in 0.617s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:33 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:46:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:46:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b614df-c468-4a82-91c4-76cee4e9c500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e09783c8-4ac9-4d54-ad7d-7510b64efd87', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:46:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85cbd1e4-cf34-4a18-8fd0-c60d04939f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:46:33 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] Volume volume-e09783c8-4ac9-4d54-ad7d-7510b64efd87 (e09783c8-4ac9-4d54-ad7d-7510b64efd87): created successfully Sep 10 19:46:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85cbd1e4-cf34-4a18-8fd0-c60d04939f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:46:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] Flow 'volume_create_manager' (6e155ec5-3691-4c66-81e3-7abfa6149ea6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:46:33 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-216c144c-34ec-4ca7-a7ff-b1812f975bc0 tempest-AbsoluteLimitsTests-715278756 None] Created volume successfully. Sep 10 19:46:34 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cff7f34e-0db6-4718-a80f-9c3e6590d2f0 tempest-AbsoluteLimitsTests-715278756 None] Acquiring lock "cinder-e09783c8-4ac9-4d54-ad7d-7510b64efd87-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:46:34 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cff7f34e-0db6-4718-a80f-9c3e6590d2f0 tempest-AbsoluteLimitsTests-715278756 None] Lock "cinder-e09783c8-4ac9-4d54-ad7d-7510b64efd87-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:46:34 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cff7f34e-0db6-4718-a80f-9c3e6590d2f0 tempest-AbsoluteLimitsTests-715278756 None] Acquiring lock "cinder-quobyte-e09783c8-4ac9-4d54-ad7d-7510b64efd87" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:46:34 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cff7f34e-0db6-4718-a80f-9c3e6590d2f0 tempest-AbsoluteLimitsTests-715278756 None] Lock "cinder-quobyte-e09783c8-4ac9-4d54-ad7d-7510b64efd87" acquired by "delete_volume" :: waited 0.036s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:46:34 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee76ee3-40d1-4aa9-b605-585ffe17a54f]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:46:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cff7f34e-0db6-4718-a80f-9c3e6590d2f0 tempest-AbsoluteLimitsTests-715278756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e09783c8-4ac9-4d54-ad7d-7510b64efd87 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:35 devstack sudo[93127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e09783c8-4ac9-4d54-ad7d-7510b64efd87 Sep 10 19:46:35 devstack sudo[93127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:35 devstack sudo[93127]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cff7f34e-0db6-4718-a80f-9c3e6590d2f0 tempest-AbsoluteLimitsTests-715278756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e09783c8-4ac9-4d54-ad7d-7510b64efd87" returned: 0 in 0.775s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cff7f34e-0db6-4718-a80f-9c3e6590d2f0 tempest-AbsoluteLimitsTests-715278756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e09783c8-4ac9-4d54-ad7d-7510b64efd87 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:35 devstack sudo[93133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e09783c8-4ac9-4d54-ad7d-7510b64efd87 Sep 10 19:46:35 devstack sudo[93133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:36 devstack sudo[93133]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cff7f34e-0db6-4718-a80f-9c3e6590d2f0 tempest-AbsoluteLimitsTests-715278756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e09783c8-4ac9-4d54-ad7d-7510b64efd87" returned: 0 in 0.484s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:36 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cff7f34e-0db6-4718-a80f-9c3e6590d2f0 tempest-AbsoluteLimitsTests-715278756 None] Lock "cinder-quobyte-e09783c8-4ac9-4d54-ad7d-7510b64efd87" released by "delete_volume" :: held 1.333s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:46:36 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-cff7f34e-0db6-4718-a80f-9c3e6590d2f0 tempest-AbsoluteLimitsTests-715278756 None] Created reservations ['2790117c-95a1-46ab-afe3-27c0b9f5c995', 'b229605f-3743-45a4-b0da-6e345328facd', '8badbcf2-4e41-4a56-815f-c4ecd504e2e1', 'f773fc43-9a7c-480b-a684-9f80da7102ba'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:46:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cff7f34e-0db6-4718-a80f-9c3e6590d2f0 tempest-AbsoluteLimitsTests-715278756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:46:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cff7f34e-0db6-4718-a80f-9c3e6590d2f0 tempest-AbsoluteLimitsTests-715278756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:46:36 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-cff7f34e-0db6-4718-a80f-9c3e6590d2f0 tempest-AbsoluteLimitsTests-715278756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:46:36 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-cff7f34e-0db6-4718-a80f-9c3e6590d2f0 tempest-AbsoluteLimitsTests-715278756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:46:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cff7f34e-0db6-4718-a80f-9c3e6590d2f0 tempest-AbsoluteLimitsTests-715278756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:46:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cff7f34e-0db6-4718-a80f-9c3e6590d2f0 tempest-AbsoluteLimitsTests-715278756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:36 devstack sudo[93140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:46:36 devstack sudo[93140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:36 devstack sudo[93140]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cff7f34e-0db6-4718-a80f-9c3e6590d2f0 tempest-AbsoluteLimitsTests-715278756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.384s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:36 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-cff7f34e-0db6-4718-a80f-9c3e6590d2f0 tempest-AbsoluteLimitsTests-715278756 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:46:36 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-cff7f34e-0db6-4718-a80f-9c3e6590d2f0 tempest-AbsoluteLimitsTests-715278756 None] Deleted volume successfully. Sep 10 19:46:36 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cff7f34e-0db6-4718-a80f-9c3e6590d2f0 tempest-AbsoluteLimitsTests-715278756 None] Lock "cinder-e09783c8-4ac9-4d54-ad7d-7510b64efd87-delete_volume" released by "delete_volume" :: held 2.111s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:46:40 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-532136d7-abfb-4421-9f39-e77a15d34fa3 tempest-TaggedAttachmentsTest-369772138 None] Acquiring lock "cinder-a7d34589-80df-45ac-b1f0-36e3d82be876-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:46:40 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-532136d7-abfb-4421-9f39-e77a15d34fa3 tempest-TaggedAttachmentsTest-369772138 None] Lock "cinder-a7d34589-80df-45ac-b1f0-36e3d82be876-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:46:40 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-532136d7-abfb-4421-9f39-e77a15d34fa3 tempest-TaggedAttachmentsTest-369772138 None] Acquiring lock "cinder-quobyte-a7d34589-80df-45ac-b1f0-36e3d82be876" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:46:40 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-532136d7-abfb-4421-9f39-e77a15d34fa3 tempest-TaggedAttachmentsTest-369772138 None] Lock "cinder-quobyte-a7d34589-80df-45ac-b1f0-36e3d82be876" acquired by "delete_volume" :: waited 0.035s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:46:41 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba67c8ee-59eb-494d-ad7c-27e337e4e546]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:46:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-532136d7-abfb-4421-9f39-e77a15d34fa3 tempest-TaggedAttachmentsTest-369772138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a7d34589-80df-45ac-b1f0-36e3d82be876 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:41 devstack sudo[93145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a7d34589-80df-45ac-b1f0-36e3d82be876 Sep 10 19:46:41 devstack sudo[93145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:41 devstack sudo[93145]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-532136d7-abfb-4421-9f39-e77a15d34fa3 tempest-TaggedAttachmentsTest-369772138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a7d34589-80df-45ac-b1f0-36e3d82be876" returned: 0 in 0.466s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-532136d7-abfb-4421-9f39-e77a15d34fa3 tempest-TaggedAttachmentsTest-369772138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a7d34589-80df-45ac-b1f0-36e3d82be876 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:41 devstack sudo[93150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a7d34589-80df-45ac-b1f0-36e3d82be876 Sep 10 19:46:41 devstack sudo[93150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:41 devstack sudo[93150]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-532136d7-abfb-4421-9f39-e77a15d34fa3 tempest-TaggedAttachmentsTest-369772138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a7d34589-80df-45ac-b1f0-36e3d82be876" returned: 0 in 0.278s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:41 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-532136d7-abfb-4421-9f39-e77a15d34fa3 tempest-TaggedAttachmentsTest-369772138 None] Lock "cinder-quobyte-a7d34589-80df-45ac-b1f0-36e3d82be876" released by "delete_volume" :: held 0.811s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:46:41 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-532136d7-abfb-4421-9f39-e77a15d34fa3 tempest-TaggedAttachmentsTest-369772138 None] Created reservations ['07252be0-f420-4b1e-94fe-1836067ba34e', '9240b160-e5dc-4d83-bafd-4e3e5369682c', 'c1958b06-640c-4eb3-a488-df09db64099b', '4432dcf1-9f95-4df2-bb27-7da285744788'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:46:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-532136d7-abfb-4421-9f39-e77a15d34fa3 tempest-TaggedAttachmentsTest-369772138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:46:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-532136d7-abfb-4421-9f39-e77a15d34fa3 tempest-TaggedAttachmentsTest-369772138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:46:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-532136d7-abfb-4421-9f39-e77a15d34fa3 tempest-TaggedAttachmentsTest-369772138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:46:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-532136d7-abfb-4421-9f39-e77a15d34fa3 tempest-TaggedAttachmentsTest-369772138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:46:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-532136d7-abfb-4421-9f39-e77a15d34fa3 tempest-TaggedAttachmentsTest-369772138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:46:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-532136d7-abfb-4421-9f39-e77a15d34fa3 tempest-TaggedAttachmentsTest-369772138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:42 devstack sudo[93153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:46:42 devstack sudo[93153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:42 devstack sudo[93153]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-532136d7-abfb-4421-9f39-e77a15d34fa3 tempest-TaggedAttachmentsTest-369772138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.374s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:42 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-532136d7-abfb-4421-9f39-e77a15d34fa3 tempest-TaggedAttachmentsTest-369772138 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:46:42 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-532136d7-abfb-4421-9f39-e77a15d34fa3 tempest-TaggedAttachmentsTest-369772138 None] Deleted volume successfully. Sep 10 19:46:42 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-532136d7-abfb-4421-9f39-e77a15d34fa3 tempest-TaggedAttachmentsTest-369772138 None] Lock "cinder-a7d34589-80df-45ac-b1f0-36e3d82be876-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:46:47 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=72,cinder:UPDATE=46,cinder:INSERT=18,cinder:DELETE=4 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:46:48 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:46:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] Flow 'volume_create_manager' (cf58ad1f-029e-4575-b75f-64663cec0622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:46:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5bbfef-bfe4-490c-80be-6f260e201a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:46:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5bbfef-bfe4-490c-80be-6f260e201a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1207975300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b2e79f0-9ccd-4514-8b87-4dc29c49ff33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe42206ae9c4496da4b0f053b66298d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:46:48Z,use_quota=True,user_id='7e5179c1537248509face0afa491c063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:46:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c30d6e-3cc4-46a3-87c7-0a07a758aa5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:46:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c30d6e-3cc4-46a3-87c7-0a07a758aa5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:46:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e9fea22-fcd0-4901-8783-0dee697453cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:46:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e9fea22-fcd0-4901-8783-0dee697453cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b2e79f0-9ccd-4514-8b87-4dc29c49ff33', 'volume_name': 'volume-6b2e79f0-9ccd-4514-8b87-4dc29c49ff33', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:46:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac39caf2-a6a9-47df-824e-cbbbcf28cc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:46:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac39caf2-a6a9-47df-824e-cbbbcf28cc21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:46:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b2a3e1b-f6fd-42ed-a1cb-e34c2a396bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:46:48 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] Volume 6b2e79f0-9ccd-4514-8b87-4dc29c49ff33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b2e79f0-9ccd-4514-8b87-4dc29c49ff33', 'volume_size': 1} Sep 10 19:46:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:46:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:46:48 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1207975300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b2e79f0-9ccd-4514-8b87-4dc29c49ff33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe42206ae9c4496da4b0f053b66298d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:46:48Z,use_quota=True,user_id='7e5179c1537248509face0afa491c063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:46:48 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] Creating volume 6b2e79f0-9ccd-4514-8b87-4dc29c49ff33 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:46:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:46:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:46:48 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:46:48 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:46:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:46:48 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:46:48 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:46:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6b2e79f0-9ccd-4514-8b87-4dc29c49ff33 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:48 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6b2e79f0-9ccd-4514-8b87-4dc29c49ff33 1073741824 Sep 10 19:46:48 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:48 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6b2e79f0-9ccd-4514-8b87-4dc29c49ff33 1073741824" returned: 0 in 0.808s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6b2e79f0-9ccd-4514-8b87-4dc29c49ff33 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:49 devstack sudo[93236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6b2e79f0-9ccd-4514-8b87-4dc29c49ff33 Sep 10 19:46:49 devstack sudo[93236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:49 devstack sudo[93236]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6b2e79f0-9ccd-4514-8b87-4dc29c49ff33" returned: 0 in 0.375s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:46:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:46:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b2a3e1b-f6fd-42ed-a1cb-e34c2a396bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b2e79f0-9ccd-4514-8b87-4dc29c49ff33', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:46:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3019f090-7983-48cc-9ddf-2c72ec02b6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:46:49 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] Volume volume-6b2e79f0-9ccd-4514-8b87-4dc29c49ff33 (6b2e79f0-9ccd-4514-8b87-4dc29c49ff33): created successfully Sep 10 19:46:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3019f090-7983-48cc-9ddf-2c72ec02b6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:46:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] Flow 'volume_create_manager' (cf58ad1f-029e-4575-b75f-64663cec0622) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:46:49 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-00d8e3ab-b87d-445d-8498-00e5c89029f0 tempest-VolumesTransfersTest-326665668 None] Created volume successfully. Sep 10 19:46:51 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-0444d984-cefa-47e8-b015-a76bff7b6cce tempest-VolumesTransfersTest-419358637 None] Transfer volume completed successfully. Sep 10 19:46:51 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-64e12227-e7b7-464f-ab9e-be7276ba1d19 req-23840a6c-8167-4d99-9341-a6ffe0f31399 tempest-AttachVolumeNegativeTest-2048411806 None] Terminate volume connection completed successfully. Sep 10 19:46:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-64e12227-e7b7-464f-ab9e-be7276ba1d19 req-23840a6c-8167-4d99-9341-a6ffe0f31399 tempest-AttachVolumeNegativeTest-2048411806 None] Deleting attachment e6946ae3-0e69-4c1a-9a1d-5cbffc39f1ec. {{(pid=88093) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 19:46:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bacf8458-98dc-47a3-8239-f047327436dc tempest-VolumesTransfersTest-2046024188 None] Acquiring lock "cinder-6b2e79f0-9ccd-4514-8b87-4dc29c49ff33-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:46:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bacf8458-98dc-47a3-8239-f047327436dc tempest-VolumesTransfersTest-2046024188 None] Lock "cinder-6b2e79f0-9ccd-4514-8b87-4dc29c49ff33-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:46:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bacf8458-98dc-47a3-8239-f047327436dc tempest-VolumesTransfersTest-2046024188 None] Acquiring lock "cinder-quobyte-6b2e79f0-9ccd-4514-8b87-4dc29c49ff33" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:46:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bacf8458-98dc-47a3-8239-f047327436dc tempest-VolumesTransfersTest-2046024188 None] Lock "cinder-quobyte-6b2e79f0-9ccd-4514-8b87-4dc29c49ff33" acquired by "delete_volume" :: waited 0.018s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:46:51 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[557d695e-d22d-4669-9c1b-6720a786e530]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:46:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bacf8458-98dc-47a3-8239-f047327436dc tempest-VolumesTransfersTest-2046024188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6b2e79f0-9ccd-4514-8b87-4dc29c49ff33 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:52 devstack sudo[93244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6b2e79f0-9ccd-4514-8b87-4dc29c49ff33 Sep 10 19:46:52 devstack sudo[93244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:52 devstack sudo[93244]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bacf8458-98dc-47a3-8239-f047327436dc tempest-VolumesTransfersTest-2046024188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6b2e79f0-9ccd-4514-8b87-4dc29c49ff33" returned: 0 in 0.470s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bacf8458-98dc-47a3-8239-f047327436dc tempest-VolumesTransfersTest-2046024188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6b2e79f0-9ccd-4514-8b87-4dc29c49ff33 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:52 devstack sudo[93252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6b2e79f0-9ccd-4514-8b87-4dc29c49ff33 Sep 10 19:46:52 devstack sudo[93252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:52 devstack sudo[93252]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bacf8458-98dc-47a3-8239-f047327436dc tempest-VolumesTransfersTest-2046024188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6b2e79f0-9ccd-4514-8b87-4dc29c49ff33" returned: 0 in 0.365s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bacf8458-98dc-47a3-8239-f047327436dc tempest-VolumesTransfersTest-2046024188 None] Lock "cinder-quobyte-6b2e79f0-9ccd-4514-8b87-4dc29c49ff33" released by "delete_volume" :: held 0.928s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:46:52 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-bacf8458-98dc-47a3-8239-f047327436dc tempest-VolumesTransfersTest-2046024188 None] Created reservations ['bf0c2841-7151-4b41-bea5-81092e069824', 'c4b0f451-0e7b-4e20-bb5b-12552f263e98', '313ab825-e67d-4e7b-b5a2-5fa7b2be80a6', '62748a1f-a486-4b74-8a84-a71dcac20476'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:46:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-bacf8458-98dc-47a3-8239-f047327436dc tempest-VolumesTransfersTest-2046024188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:46:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-bacf8458-98dc-47a3-8239-f047327436dc tempest-VolumesTransfersTest-2046024188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:46:53 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-bacf8458-98dc-47a3-8239-f047327436dc tempest-VolumesTransfersTest-2046024188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:46:53 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-bacf8458-98dc-47a3-8239-f047327436dc tempest-VolumesTransfersTest-2046024188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:46:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-bacf8458-98dc-47a3-8239-f047327436dc tempest-VolumesTransfersTest-2046024188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:46:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bacf8458-98dc-47a3-8239-f047327436dc tempest-VolumesTransfersTest-2046024188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:53 devstack sudo[93274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:46:53 devstack sudo[93274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:53 devstack sudo[93274]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bacf8458-98dc-47a3-8239-f047327436dc tempest-VolumesTransfersTest-2046024188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.303s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:53 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-bacf8458-98dc-47a3-8239-f047327436dc tempest-VolumesTransfersTest-2046024188 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:46:53 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-bacf8458-98dc-47a3-8239-f047327436dc tempest-VolumesTransfersTest-2046024188 None] Deleted volume successfully. Sep 10 19:46:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bacf8458-98dc-47a3-8239-f047327436dc tempest-VolumesTransfersTest-2046024188 None] Lock "cinder-6b2e79f0-9ccd-4514-8b87-4dc29c49ff33-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:46:55 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:46:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] Flow 'volume_create_manager' (3d106c67-01de-45f3-9f34-521026fb5d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:46:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba182e1-32d0-4ba7-b9be-d4b0b595390c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:46:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba182e1-32d0-4ba7-b9be-d4b0b595390c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1637082377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b8be100-8b46-49fe-bd8d-f143f20ebdee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe42206ae9c4496da4b0f053b66298d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:46:55Z,use_quota=True,user_id='7e5179c1537248509face0afa491c063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:46:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b40138e3-003f-4347-9ee2-75078c7b9bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:46:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b40138e3-003f-4347-9ee2-75078c7b9bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:46:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f016643-fd17-4e3c-96ad-8550e3fb27dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:46:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f016643-fd17-4e3c-96ad-8550e3fb27dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b8be100-8b46-49fe-bd8d-f143f20ebdee', 'volume_name': 'volume-2b8be100-8b46-49fe-bd8d-f143f20ebdee', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:46:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5987432b-d999-4c41-bfe9-edccbb06ef26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:46:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5987432b-d999-4c41-bfe9-edccbb06ef26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:46:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db579775-43c1-4ef4-ba34-5b3b57ac67ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:46:55 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] Volume 2b8be100-8b46-49fe-bd8d-f143f20ebdee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b8be100-8b46-49fe-bd8d-f143f20ebdee', 'volume_size': 1} Sep 10 19:46:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:46:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:46:55 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1637082377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b8be100-8b46-49fe-bd8d-f143f20ebdee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe42206ae9c4496da4b0f053b66298d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:46:55Z,use_quota=True,user_id='7e5179c1537248509face0afa491c063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:46:55 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] Creating volume 2b8be100-8b46-49fe-bd8d-f143f20ebdee {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:46:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:46:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:46:55 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:46:55 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:46:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:46:55 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:46:55 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:46:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2b8be100-8b46-49fe-bd8d-f143f20ebdee 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:55 devstack sudo[93283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2b8be100-8b46-49fe-bd8d-f143f20ebdee 1073741824 Sep 10 19:46:55 devstack sudo[93283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:55 devstack sudo[93283]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2b8be100-8b46-49fe-bd8d-f143f20ebdee 1073741824" returned: 0 in 0.626s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2b8be100-8b46-49fe-bd8d-f143f20ebdee {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:55 devstack sudo[93290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2b8be100-8b46-49fe-bd8d-f143f20ebdee Sep 10 19:46:55 devstack sudo[93290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:56 devstack sudo[93290]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2b8be100-8b46-49fe-bd8d-f143f20ebdee" returned: 0 in 0.492s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:46:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:46:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db579775-43c1-4ef4-ba34-5b3b57ac67ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b8be100-8b46-49fe-bd8d-f143f20ebdee', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:46:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e84912c-9ab8-4a46-bc5a-18cca181ec81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:46:56 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] Volume volume-2b8be100-8b46-49fe-bd8d-f143f20ebdee (2b8be100-8b46-49fe-bd8d-f143f20ebdee): created successfully Sep 10 19:46:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e84912c-9ab8-4a46-bc5a-18cca181ec81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:46:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] Flow 'volume_create_manager' (3d106c67-01de-45f3-9f34-521026fb5d07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:46:56 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-f9db7070-0bc9-4152-9b25-42bb183e05d0 tempest-VolumesTransfersTest-326665668 None] Created volume successfully. Sep 10 19:46:57 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d48db69c-af49-43b0-b7c5-b939fbca8635 tempest-VolumesTransfersTest-2046024188 None] Acquiring lock "cinder-2b8be100-8b46-49fe-bd8d-f143f20ebdee-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:46:57 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d48db69c-af49-43b0-b7c5-b939fbca8635 tempest-VolumesTransfersTest-2046024188 None] Lock "cinder-2b8be100-8b46-49fe-bd8d-f143f20ebdee-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:46:57 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d48db69c-af49-43b0-b7c5-b939fbca8635 tempest-VolumesTransfersTest-2046024188 None] Acquiring lock "cinder-quobyte-2b8be100-8b46-49fe-bd8d-f143f20ebdee" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:46:57 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d48db69c-af49-43b0-b7c5-b939fbca8635 tempest-VolumesTransfersTest-2046024188 None] Lock "cinder-quobyte-2b8be100-8b46-49fe-bd8d-f143f20ebdee" acquired by "delete_volume" :: waited 0.035s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:46:57 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2ed0e8-c472-4994-92d9-67b9d9fa0bd7]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:46:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d48db69c-af49-43b0-b7c5-b939fbca8635 tempest-VolumesTransfersTest-2046024188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2b8be100-8b46-49fe-bd8d-f143f20ebdee {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:57 devstack sudo[93303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2b8be100-8b46-49fe-bd8d-f143f20ebdee Sep 10 19:46:57 devstack sudo[93303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:58 devstack sudo[93303]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d48db69c-af49-43b0-b7c5-b939fbca8635 tempest-VolumesTransfersTest-2046024188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2b8be100-8b46-49fe-bd8d-f143f20ebdee" returned: 0 in 0.503s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d48db69c-af49-43b0-b7c5-b939fbca8635 tempest-VolumesTransfersTest-2046024188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2b8be100-8b46-49fe-bd8d-f143f20ebdee {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:58 devstack sudo[93308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2b8be100-8b46-49fe-bd8d-f143f20ebdee Sep 10 19:46:58 devstack sudo[93308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:58 devstack sudo[93308]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d48db69c-af49-43b0-b7c5-b939fbca8635 tempest-VolumesTransfersTest-2046024188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2b8be100-8b46-49fe-bd8d-f143f20ebdee" returned: 0 in 0.533s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:58 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d48db69c-af49-43b0-b7c5-b939fbca8635 tempest-VolumesTransfersTest-2046024188 None] Lock "cinder-quobyte-2b8be100-8b46-49fe-bd8d-f143f20ebdee" released by "delete_volume" :: held 1.112s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:46:58 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-d48db69c-af49-43b0-b7c5-b939fbca8635 tempest-VolumesTransfersTest-2046024188 None] Created reservations ['41988b7e-83a2-4415-9126-176305570c44', '8b93bcbb-dbe0-40f6-aea0-682c6a5f86af', '84d4d81d-d006-4ac9-9462-9ada2b63c212', '6e271efd-eedd-4aba-853c-ab5ce4353f40'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:46:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d48db69c-af49-43b0-b7c5-b939fbca8635 tempest-VolumesTransfersTest-2046024188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:46:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d48db69c-af49-43b0-b7c5-b939fbca8635 tempest-VolumesTransfersTest-2046024188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:46:59 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d48db69c-af49-43b0-b7c5-b939fbca8635 tempest-VolumesTransfersTest-2046024188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:46:59 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d48db69c-af49-43b0-b7c5-b939fbca8635 tempest-VolumesTransfersTest-2046024188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:46:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d48db69c-af49-43b0-b7c5-b939fbca8635 tempest-VolumesTransfersTest-2046024188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:46:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d48db69c-af49-43b0-b7c5-b939fbca8635 tempest-VolumesTransfersTest-2046024188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:46:59 devstack sudo[93314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:46:59 devstack sudo[93314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:46:59 devstack sudo[93314]: pam_unix(sudo:session): session closed for user root Sep 10 19:46:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d48db69c-af49-43b0-b7c5-b939fbca8635 tempest-VolumesTransfersTest-2046024188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.368s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:46:59 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-d48db69c-af49-43b0-b7c5-b939fbca8635 tempest-VolumesTransfersTest-2046024188 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:46:59 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-d48db69c-af49-43b0-b7c5-b939fbca8635 tempest-VolumesTransfersTest-2046024188 None] Deleted volume successfully. Sep 10 19:46:59 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d48db69c-af49-43b0-b7c5-b939fbca8635 tempest-VolumesTransfersTest-2046024188 None] Lock "cinder-2b8be100-8b46-49fe-bd8d-f143f20ebdee-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:47:01 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-1067d5be-5042-4622-96cd-71a1cde80d51 req-956280bc-c12c-4de3-99b8-2b376743e61e tempest-ServerActionsTestOtherA-1390177495 None] Terminate volume connection completed successfully. Sep 10 19:47:01 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-1067d5be-5042-4622-96cd-71a1cde80d51 req-956280bc-c12c-4de3-99b8-2b376743e61e tempest-ServerActionsTestOtherA-1390177495 None] Deleting attachment dc6f004c-6fbf-4942-865b-de16ad11db57. {{(pid=88093) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 19:47:01 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-1067d5be-5042-4622-96cd-71a1cde80d51 req-46e7edc2-5ef3-48da-9433-38bb8a4302e8 tempest-ServerActionsTestOtherA-1390177495 None] Acquiring lock "cinder-342a6110-8faa-4351-a820-92326f101bf5-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:47:01 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-1067d5be-5042-4622-96cd-71a1cde80d51 req-46e7edc2-5ef3-48da-9433-38bb8a4302e8 tempest-ServerActionsTestOtherA-1390177495 None] Lock "cinder-342a6110-8faa-4351-a820-92326f101bf5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:47:02 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-1067d5be-5042-4622-96cd-71a1cde80d51 req-46e7edc2-5ef3-48da-9433-38bb8a4302e8 tempest-ServerActionsTestOtherA-1390177495 None] Acquiring lock "cinder-quobyte-342a6110-8faa-4351-a820-92326f101bf5" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:47:02 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-1067d5be-5042-4622-96cd-71a1cde80d51 req-46e7edc2-5ef3-48da-9433-38bb8a4302e8 tempest-ServerActionsTestOtherA-1390177495 None] Lock "cinder-quobyte-342a6110-8faa-4351-a820-92326f101bf5" acquired by "delete_volume" :: waited 0.035s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:47:02 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b995b28-3df0-4c20-8417-bc6571e08783]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:47:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-1067d5be-5042-4622-96cd-71a1cde80d51 req-46e7edc2-5ef3-48da-9433-38bb8a4302e8 tempest-ServerActionsTestOtherA-1390177495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-342a6110-8faa-4351-a820-92326f101bf5 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:02 devstack sudo[93345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-342a6110-8faa-4351-a820-92326f101bf5 Sep 10 19:47:02 devstack sudo[93345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:02 devstack sudo[93345]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-1067d5be-5042-4622-96cd-71a1cde80d51 req-46e7edc2-5ef3-48da-9433-38bb8a4302e8 tempest-ServerActionsTestOtherA-1390177495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-342a6110-8faa-4351-a820-92326f101bf5" returned: 0 in 0.567s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-1067d5be-5042-4622-96cd-71a1cde80d51 req-46e7edc2-5ef3-48da-9433-38bb8a4302e8 tempest-ServerActionsTestOtherA-1390177495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-342a6110-8faa-4351-a820-92326f101bf5 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:02 devstack sudo[93350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-342a6110-8faa-4351-a820-92326f101bf5 Sep 10 19:47:02 devstack sudo[93350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:02 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-46df229f-4278-44f5-9e0f-78ad9ed486f8 tempest-ServerActionsTestOtherA-1390177495 None] Acquiring lock "cinder-eaab1202-41f0-474c-a25f-f58a53f14dce-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:47:03 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-46df229f-4278-44f5-9e0f-78ad9ed486f8 tempest-ServerActionsTestOtherA-1390177495 None] Lock "cinder-eaab1202-41f0-474c-a25f-f58a53f14dce-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:47:03 devstack sudo[93350]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-1067d5be-5042-4622-96cd-71a1cde80d51 req-46e7edc2-5ef3-48da-9433-38bb8a4302e8 tempest-ServerActionsTestOtherA-1390177495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-342a6110-8faa-4351-a820-92326f101bf5" returned: 0 in 0.393s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:03 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-1067d5be-5042-4622-96cd-71a1cde80d51 req-46e7edc2-5ef3-48da-9433-38bb8a4302e8 tempest-ServerActionsTestOtherA-1390177495 None] Lock "cinder-quobyte-342a6110-8faa-4351-a820-92326f101bf5" released by "delete_volume" :: held 1.052s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:47:03 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-46df229f-4278-44f5-9e0f-78ad9ed486f8 tempest-ServerActionsTestOtherA-1390177495 None] Acquiring lock "cinder-quobyte-eaab1202-41f0-474c-a25f-f58a53f14dce" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:47:03 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-46df229f-4278-44f5-9e0f-78ad9ed486f8 tempest-ServerActionsTestOtherA-1390177495 None] Lock "cinder-quobyte-eaab1202-41f0-474c-a25f-f58a53f14dce" acquired by "delete_volume" :: waited 0.032s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:47:03 devstack cinder-volume[88093]: DEBUG cinder.quota [req-1067d5be-5042-4622-96cd-71a1cde80d51 req-46e7edc2-5ef3-48da-9433-38bb8a4302e8 tempest-ServerActionsTestOtherA-1390177495 None] Created reservations ['f093771c-3fa5-449d-9ea6-76286a69d025', '01edbb3e-74b0-42e7-ba2b-8b867cda954d', 'cc8975f1-7f49-4a47-965c-f8b24d604dd3', '27873c8b-50a7-4a8b-899c-eb647bd82b14'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:47:03 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9bb510-039b-4991-a29d-9df8fd86ce0a]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:47:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-46df229f-4278-44f5-9e0f-78ad9ed486f8 tempest-ServerActionsTestOtherA-1390177495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-eaab1202-41f0-474c-a25f-f58a53f14dce {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-1067d5be-5042-4622-96cd-71a1cde80d51 req-46e7edc2-5ef3-48da-9433-38bb8a4302e8 tempest-ServerActionsTestOtherA-1390177495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:47:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-1067d5be-5042-4622-96cd-71a1cde80d51 req-46e7edc2-5ef3-48da-9433-38bb8a4302e8 tempest-ServerActionsTestOtherA-1390177495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:47:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [req-1067d5be-5042-4622-96cd-71a1cde80d51 req-46e7edc2-5ef3-48da-9433-38bb8a4302e8 tempest-ServerActionsTestOtherA-1390177495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:47:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [req-1067d5be-5042-4622-96cd-71a1cde80d51 req-46e7edc2-5ef3-48da-9433-38bb8a4302e8 tempest-ServerActionsTestOtherA-1390177495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:47:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-1067d5be-5042-4622-96cd-71a1cde80d51 req-46e7edc2-5ef3-48da-9433-38bb8a4302e8 tempest-ServerActionsTestOtherA-1390177495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:47:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-1067d5be-5042-4622-96cd-71a1cde80d51 req-46e7edc2-5ef3-48da-9433-38bb8a4302e8 tempest-ServerActionsTestOtherA-1390177495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:03 devstack sudo[93354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:47:03 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:03 devstack sudo[93353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-eaab1202-41f0-474c-a25f-f58a53f14dce Sep 10 19:47:03 devstack sudo[93353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:03 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-1067d5be-5042-4622-96cd-71a1cde80d51 req-46e7edc2-5ef3-48da-9433-38bb8a4302e8 tempest-ServerActionsTestOtherA-1390177495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.351s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:03 devstack cinder-volume[88093]: DEBUG cinder.manager [req-1067d5be-5042-4622-96cd-71a1cde80d51 req-46e7edc2-5ef3-48da-9433-38bb8a4302e8 tempest-ServerActionsTestOtherA-1390177495 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:47:03 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-1067d5be-5042-4622-96cd-71a1cde80d51 req-46e7edc2-5ef3-48da-9433-38bb8a4302e8 tempest-ServerActionsTestOtherA-1390177495 None] Deleted volume successfully. Sep 10 19:47:03 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-1067d5be-5042-4622-96cd-71a1cde80d51 req-46e7edc2-5ef3-48da-9433-38bb8a4302e8 tempest-ServerActionsTestOtherA-1390177495 None] Lock "cinder-342a6110-8faa-4351-a820-92326f101bf5-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:47:03 devstack sudo[93353]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-46df229f-4278-44f5-9e0f-78ad9ed486f8 tempest-ServerActionsTestOtherA-1390177495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-eaab1202-41f0-474c-a25f-f58a53f14dce" returned: 0 in 0.577s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-46df229f-4278-44f5-9e0f-78ad9ed486f8 tempest-ServerActionsTestOtherA-1390177495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-eaab1202-41f0-474c-a25f-f58a53f14dce {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:03 devstack sudo[93361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-eaab1202-41f0-474c-a25f-f58a53f14dce Sep 10 19:47:03 devstack sudo[93361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:03 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:47:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:47:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:47:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:47:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:47:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:47:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:03 devstack sudo[93363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:47:03 devstack sudo[93363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:04 devstack sudo[93361]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-46df229f-4278-44f5-9e0f-78ad9ed486f8 tempest-ServerActionsTestOtherA-1390177495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-eaab1202-41f0-474c-a25f-f58a53f14dce" returned: 0 in 0.320s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:04 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-46df229f-4278-44f5-9e0f-78ad9ed486f8 tempest-ServerActionsTestOtherA-1390177495 None] Lock "cinder-quobyte-eaab1202-41f0-474c-a25f-f58a53f14dce" released by "delete_volume" :: held 0.968s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:47:04 devstack sudo[93363]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.365s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:04 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:47:04 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager._thread_info {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:47:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread count: 28 {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 19:47:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread info: [<_MainThread(MainThread, started 138417491665024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 19:47:04 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-46df229f-4278-44f5-9e0f-78ad9ed486f8 tempest-ServerActionsTestOtherA-1390177495 None] Created reservations ['68228e88-3054-43e9-8286-8b26eadd6261', '171096db-5df9-485b-9901-5ab5f53d692d', '995d53c8-c591-44f9-9abe-4f82c8ebd3a9', '550b588c-258e-476b-b686-7648f913b4a6'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:47:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-46df229f-4278-44f5-9e0f-78ad9ed486f8 tempest-ServerActionsTestOtherA-1390177495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:47:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-46df229f-4278-44f5-9e0f-78ad9ed486f8 tempest-ServerActionsTestOtherA-1390177495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:47:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-46df229f-4278-44f5-9e0f-78ad9ed486f8 tempest-ServerActionsTestOtherA-1390177495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:47:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-46df229f-4278-44f5-9e0f-78ad9ed486f8 tempest-ServerActionsTestOtherA-1390177495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:47:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-46df229f-4278-44f5-9e0f-78ad9ed486f8 tempest-ServerActionsTestOtherA-1390177495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:47:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-46df229f-4278-44f5-9e0f-78ad9ed486f8 tempest-ServerActionsTestOtherA-1390177495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:04 devstack sudo[93367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:47:04 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:04 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-46df229f-4278-44f5-9e0f-78ad9ed486f8 tempest-ServerActionsTestOtherA-1390177495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.291s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:04 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-46df229f-4278-44f5-9e0f-78ad9ed486f8 tempest-ServerActionsTestOtherA-1390177495 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:47:04 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-46df229f-4278-44f5-9e0f-78ad9ed486f8 tempest-ServerActionsTestOtherA-1390177495 None] Deleted volume successfully. Sep 10 19:47:04 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-46df229f-4278-44f5-9e0f-78ad9ed486f8 tempest-ServerActionsTestOtherA-1390177495 None] Lock "cinder-eaab1202-41f0-474c-a25f-f58a53f14dce-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:47:10 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:47:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] Flow 'volume_create_manager' (440fc658-4879-49cf-84fe-83e3809a7e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:47:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3739f31-8240-46c4-8219-3771b8067c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3739f31-8240-46c4-8219-3771b8067c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1790822415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b0f8a4-1a96-4ca9-a8a9-23522ef84f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d286ce28a344b45a053f9e1c180a79f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:47:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:47:11Z,use_quota=True,user_id='0e55fd436c3f40c5a73234242fe378cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce65035-2a76-4661-8381-ab9318f02530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce65035-2a76-4661-8381-ab9318f02530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (529e3dd5-b710-4979-89de-1f87b6968492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (529e3dd5-b710-4979-89de-1f87b6968492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2b0f8a4-1a96-4ca9-a8a9-23522ef84f0d', 'volume_name': 'volume-f2b0f8a4-1a96-4ca9-a8a9-23522ef84f0d', 'volume_size': 2}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e21497-e4bf-4326-8497-c4a07d0eeb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e21497-e4bf-4326-8497-c4a07d0eeb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025c702d-f765-4371-8c3c-615fac071771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:10 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] Volume f2b0f8a4-1a96-4ca9-a8a9-23522ef84f0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2b0f8a4-1a96-4ca9-a8a9-23522ef84f0d', 'volume_size': 2} Sep 10 19:47:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:47:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:47:10 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1790822415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b0f8a4-1a96-4ca9-a8a9-23522ef84f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d286ce28a344b45a053f9e1c180a79f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:47:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:47:11Z,use_quota=True,user_id='0e55fd436c3f40c5a73234242fe378cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:47:10 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] Creating volume f2b0f8a4-1a96-4ca9-a8a9-23522ef84f0d {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:47:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:47:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:47:10 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:47:10 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:47:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:47:10 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:47:10 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:47:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f2b0f8a4-1a96-4ca9-a8a9-23522ef84f0d 2147483648 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:10 devstack sudo[93418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f2b0f8a4-1a96-4ca9-a8a9-23522ef84f0d 2147483648 Sep 10 19:47:10 devstack sudo[93418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:11 devstack sudo[93418]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f2b0f8a4-1a96-4ca9-a8a9-23522ef84f0d 2147483648" returned: 0 in 0.676s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f2b0f8a4-1a96-4ca9-a8a9-23522ef84f0d {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:11 devstack sudo[93425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f2b0f8a4-1a96-4ca9-a8a9-23522ef84f0d Sep 10 19:47:11 devstack sudo[93425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:11 devstack sudo[93425]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f2b0f8a4-1a96-4ca9-a8a9-23522ef84f0d" returned: 0 in 0.339s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:47:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:47:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025c702d-f765-4371-8c3c-615fac071771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2b0f8a4-1a96-4ca9-a8a9-23522ef84f0d', 'volume_size': 2}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfe7c39f-1771-4421-a0ae-f51be747b9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:11 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] Volume volume-f2b0f8a4-1a96-4ca9-a8a9-23522ef84f0d (f2b0f8a4-1a96-4ca9-a8a9-23522ef84f0d): created successfully Sep 10 19:47:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfe7c39f-1771-4421-a0ae-f51be747b9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] Flow 'volume_create_manager' (440fc658-4879-49cf-84fe-83e3809a7e0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:47:11 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-3421b9ae-38ff-4c7f-841d-2058ca4eaa80 tempest-VolumesCloneNegativeTest-1863926799 None] Created volume successfully. Sep 10 19:47:12 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-07a63537-7236-4fb6-90d3-f7734cc7e1db tempest-VolumesCloneNegativeTest-1863926799 None] Acquiring lock "cinder-f2b0f8a4-1a96-4ca9-a8a9-23522ef84f0d-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:47:12 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-07a63537-7236-4fb6-90d3-f7734cc7e1db tempest-VolumesCloneNegativeTest-1863926799 None] Lock "cinder-f2b0f8a4-1a96-4ca9-a8a9-23522ef84f0d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:47:12 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-07a63537-7236-4fb6-90d3-f7734cc7e1db tempest-VolumesCloneNegativeTest-1863926799 None] Acquiring lock "cinder-quobyte-f2b0f8a4-1a96-4ca9-a8a9-23522ef84f0d" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:47:12 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-07a63537-7236-4fb6-90d3-f7734cc7e1db tempest-VolumesCloneNegativeTest-1863926799 None] Lock "cinder-quobyte-f2b0f8a4-1a96-4ca9-a8a9-23522ef84f0d" acquired by "delete_volume" :: waited 0.023s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:47:13 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc530031-a6fc-4dae-b155-b08c1dca04d0]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:47:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-07a63537-7236-4fb6-90d3-f7734cc7e1db tempest-VolumesCloneNegativeTest-1863926799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f2b0f8a4-1a96-4ca9-a8a9-23522ef84f0d {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:13 devstack sudo[93429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f2b0f8a4-1a96-4ca9-a8a9-23522ef84f0d Sep 10 19:47:13 devstack sudo[93429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:13 devstack sudo[93429]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-07a63537-7236-4fb6-90d3-f7734cc7e1db tempest-VolumesCloneNegativeTest-1863926799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f2b0f8a4-1a96-4ca9-a8a9-23522ef84f0d" returned: 0 in 0.401s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-07a63537-7236-4fb6-90d3-f7734cc7e1db tempest-VolumesCloneNegativeTest-1863926799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f2b0f8a4-1a96-4ca9-a8a9-23522ef84f0d {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:13 devstack sudo[93434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f2b0f8a4-1a96-4ca9-a8a9-23522ef84f0d Sep 10 19:47:13 devstack sudo[93434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:13 devstack sudo[93434]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-07a63537-7236-4fb6-90d3-f7734cc7e1db tempest-VolumesCloneNegativeTest-1863926799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f2b0f8a4-1a96-4ca9-a8a9-23522ef84f0d" returned: 0 in 0.296s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:13 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-07a63537-7236-4fb6-90d3-f7734cc7e1db tempest-VolumesCloneNegativeTest-1863926799 None] Lock "cinder-quobyte-f2b0f8a4-1a96-4ca9-a8a9-23522ef84f0d" released by "delete_volume" :: held 0.738s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:47:13 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-07a63537-7236-4fb6-90d3-f7734cc7e1db tempest-VolumesCloneNegativeTest-1863926799 None] Created reservations ['e073c7dd-2919-41eb-b63a-859cddb9028c', 'a4af3d20-4338-4c40-8b2b-49c841196ffa', '390f9cd3-8bbe-4d44-a5aa-b5d978cc2416', '25f8d6ac-ab26-4002-a51a-5e8f3e54d89f'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:47:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-07a63537-7236-4fb6-90d3-f7734cc7e1db tempest-VolumesCloneNegativeTest-1863926799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:47:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-07a63537-7236-4fb6-90d3-f7734cc7e1db tempest-VolumesCloneNegativeTest-1863926799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:47:13 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-07a63537-7236-4fb6-90d3-f7734cc7e1db tempest-VolumesCloneNegativeTest-1863926799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:47:13 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-07a63537-7236-4fb6-90d3-f7734cc7e1db tempest-VolumesCloneNegativeTest-1863926799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:47:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-07a63537-7236-4fb6-90d3-f7734cc7e1db tempest-VolumesCloneNegativeTest-1863926799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:47:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-07a63537-7236-4fb6-90d3-f7734cc7e1db tempest-VolumesCloneNegativeTest-1863926799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:13 devstack sudo[93437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:47:13 devstack sudo[93437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:14 devstack sudo[93437]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-07a63537-7236-4fb6-90d3-f7734cc7e1db tempest-VolumesCloneNegativeTest-1863926799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.278s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:14 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-07a63537-7236-4fb6-90d3-f7734cc7e1db tempest-VolumesCloneNegativeTest-1863926799 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:47:14 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-07a63537-7236-4fb6-90d3-f7734cc7e1db tempest-VolumesCloneNegativeTest-1863926799 None] Deleted volume successfully. Sep 10 19:47:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-07a63537-7236-4fb6-90d3-f7734cc7e1db tempest-VolumesCloneNegativeTest-1863926799 None] Lock "cinder-f2b0f8a4-1a96-4ca9-a8a9-23522ef84f0d-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:47:23 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=66,cinder:UPDATE=81,cinder:INSERT=16,cinder:DELETE=7 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:47:23 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:47:23 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] Flow 'volume_create_manager' (cbd9a87f-211b-43d7-b779-513fb644a4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:47:23 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59efef3d-9ec0-4083-b65d-5e28606056f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:23 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59efef3d-9ec0-4083-b65d-5e28606056f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1810860335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c1c0fb-ef97-4970-bb54-82735a76cd30,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d81bfdcb494e4048a0e970e37edc3400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:47:24Z,use_quota=True,user_id='0174539f758c4c708df7860619cadf13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:23 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12807faf-f3fc-482d-b9ba-bbbc8be1c35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:23 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12807faf-f3fc-482d-b9ba-bbbc8be1c35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:23 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e584588-372f-4588-bcc6-3b1697b7139d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:23 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e584588-372f-4588-bcc6-3b1697b7139d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05c1c0fb-ef97-4970-bb54-82735a76cd30', 'volume_name': 'volume-05c1c0fb-ef97-4970-bb54-82735a76cd30', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:23 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5f47f2-8602-4850-9188-4702df11a92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:24 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5f47f2-8602-4850-9188-4702df11a92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:24 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e5ecbd-9dc1-4e56-82ab-5c6d5cf3ace4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:24 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] Volume 05c1c0fb-ef97-4970-bb54-82735a76cd30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05c1c0fb-ef97-4970-bb54-82735a76cd30', 'volume_size': 1} Sep 10 19:47:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:47:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:47:24 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1810860335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c1c0fb-ef97-4970-bb54-82735a76cd30,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d81bfdcb494e4048a0e970e37edc3400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:47:24Z,use_quota=True,user_id='0174539f758c4c708df7860619cadf13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:47:24 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] Creating volume 05c1c0fb-ef97-4970-bb54-82735a76cd30 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:47:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:47:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:47:24 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:47:24 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:47:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:47:24 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:47:24 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:47:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-05c1c0fb-ef97-4970-bb54-82735a76cd30 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:24 devstack sudo[93575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-05c1c0fb-ef97-4970-bb54-82735a76cd30 1073741824 Sep 10 19:47:24 devstack sudo[93575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:24 devstack sudo[93575]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-05c1c0fb-ef97-4970-bb54-82735a76cd30 1073741824" returned: 0 in 0.669s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-05c1c0fb-ef97-4970-bb54-82735a76cd30 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:24 devstack sudo[93581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-05c1c0fb-ef97-4970-bb54-82735a76cd30 Sep 10 19:47:24 devstack sudo[93581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:25 devstack sudo[93581]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-05c1c0fb-ef97-4970-bb54-82735a76cd30" returned: 0 in 0.420s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:25 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:47:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:47:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e5ecbd-9dc1-4e56-82ab-5c6d5cf3ace4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05c1c0fb-ef97-4970-bb54-82735a76cd30', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2faf4d8-ef98-4f68-8254-2c0a429fc17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:25 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] Volume volume-05c1c0fb-ef97-4970-bb54-82735a76cd30 (05c1c0fb-ef97-4970-bb54-82735a76cd30): created successfully Sep 10 19:47:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2faf4d8-ef98-4f68-8254-2c0a429fc17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] Flow 'volume_create_manager' (cbd9a87f-211b-43d7-b779-513fb644a4c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:47:25 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-05c2da14-6aa0-4f70-a79e-c861bed84260 tempest-VolumesListTestJSON-1713815007 None] Created volume successfully. Sep 10 19:47:27 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:47:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] Flow 'volume_create_manager' (381e3db0-4d85-4dd5-8ea2-5de921d42e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:47:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a5cb0b1-3de5-43cf-9dcd-6439a171476d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a5cb0b1-3de5-43cf-9dcd-6439a171476d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2063636066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e7aa4e-e719-4048-8fa4-2e69c8e274f5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d81bfdcb494e4048a0e970e37edc3400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:47:27Z,use_quota=True,user_id='0174539f758c4c708df7860619cadf13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3606418-6de0-48dd-9815-aabc61635bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3606418-6de0-48dd-9815-aabc61635bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab309ed-4e6c-4830-9d04-61ac9a609093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab309ed-4e6c-4830-9d04-61ac9a609093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45e7aa4e-e719-4048-8fa4-2e69c8e274f5', 'volume_name': 'volume-45e7aa4e-e719-4048-8fa4-2e69c8e274f5', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e40773-de9c-4b39-9995-04a6ef00de9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e40773-de9c-4b39-9995-04a6ef00de9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccdc0d42-137d-48af-b1ec-c339d2a2e0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:27 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] Volume 45e7aa4e-e719-4048-8fa4-2e69c8e274f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45e7aa4e-e719-4048-8fa4-2e69c8e274f5', 'volume_size': 1} Sep 10 19:47:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:47:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:47:27 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2063636066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e7aa4e-e719-4048-8fa4-2e69c8e274f5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d81bfdcb494e4048a0e970e37edc3400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:47:27Z,use_quota=True,user_id='0174539f758c4c708df7860619cadf13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:47:27 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] Creating volume 45e7aa4e-e719-4048-8fa4-2e69c8e274f5 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:47:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:47:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:47:27 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:47:27 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:47:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:47:27 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:47:27 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:47:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-45e7aa4e-e719-4048-8fa4-2e69c8e274f5 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:27 devstack sudo[93647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-45e7aa4e-e719-4048-8fa4-2e69c8e274f5 1073741824 Sep 10 19:47:27 devstack sudo[93647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:28 devstack sudo[93647]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-45e7aa4e-e719-4048-8fa4-2e69c8e274f5 1073741824" returned: 0 in 0.830s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-45e7aa4e-e719-4048-8fa4-2e69c8e274f5 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:28 devstack sudo[93660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-45e7aa4e-e719-4048-8fa4-2e69c8e274f5 Sep 10 19:47:28 devstack sudo[93660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:29 devstack sudo[93660]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-45e7aa4e-e719-4048-8fa4-2e69c8e274f5" returned: 0 in 0.649s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:29 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:47:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:47:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccdc0d42-137d-48af-b1ec-c339d2a2e0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45e7aa4e-e719-4048-8fa4-2e69c8e274f5', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9551497b-2bd7-42c2-a966-ee4c03039520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:29 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] Volume volume-45e7aa4e-e719-4048-8fa4-2e69c8e274f5 (45e7aa4e-e719-4048-8fa4-2e69c8e274f5): created successfully Sep 10 19:47:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9551497b-2bd7-42c2-a966-ee4c03039520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] Flow 'volume_create_manager' (381e3db0-4d85-4dd5-8ea2-5de921d42e21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:47:29 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-0fb4452e-1dbe-45f0-80a0-5a3a812d350f tempest-VolumesListTestJSON-1713815007 None] Created volume successfully. Sep 10 19:47:31 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:47:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] Flow 'volume_create_manager' (35a59516-3e7c-4efd-8b22-cf4d14913484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:47:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f7846c8-2a38-4b64-9545-d1aa6dc89bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f7846c8-2a38-4b64-9545-d1aa6dc89bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1857047774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ff1bf6-8a9c-4a45-8ce2-222f76d01a8b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d81bfdcb494e4048a0e970e37edc3400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:47:32Z,use_quota=True,user_id='0174539f758c4c708df7860619cadf13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e84246c4-4b27-4646-9e56-2b44a5c7de12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e84246c4-4b27-4646-9e56-2b44a5c7de12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28b0507c-5671-41e9-9543-b3ac196c75c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28b0507c-5671-41e9-9543-b3ac196c75c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73ff1bf6-8a9c-4a45-8ce2-222f76d01a8b', 'volume_name': 'volume-73ff1bf6-8a9c-4a45-8ce2-222f76d01a8b', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c9ccb6-cb76-4bc9-b603-3fd3c13e8e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c9ccb6-cb76-4bc9-b603-3fd3c13e8e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372e8693-180b-4944-b48d-b8bf734a75a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:31 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] Volume 73ff1bf6-8a9c-4a45-8ce2-222f76d01a8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73ff1bf6-8a9c-4a45-8ce2-222f76d01a8b', 'volume_size': 1} Sep 10 19:47:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:47:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:47:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1857047774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ff1bf6-8a9c-4a45-8ce2-222f76d01a8b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d81bfdcb494e4048a0e970e37edc3400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:47:32Z,use_quota=True,user_id='0174539f758c4c708df7860619cadf13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:47:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] Creating volume 73ff1bf6-8a9c-4a45-8ce2-222f76d01a8b {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:47:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:47:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:47:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:47:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:47:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:47:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:47:31 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:47:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-73ff1bf6-8a9c-4a45-8ce2-222f76d01a8b 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:31 devstack sudo[93665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-73ff1bf6-8a9c-4a45-8ce2-222f76d01a8b 1073741824 Sep 10 19:47:31 devstack sudo[93665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:32 devstack sudo[93665]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-73ff1bf6-8a9c-4a45-8ce2-222f76d01a8b 1073741824" returned: 0 in 1.164s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-73ff1bf6-8a9c-4a45-8ce2-222f76d01a8b {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:33 devstack sudo[93703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-73ff1bf6-8a9c-4a45-8ce2-222f76d01a8b Sep 10 19:47:33 devstack sudo[93703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:33 devstack sudo[93703]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-73ff1bf6-8a9c-4a45-8ce2-222f76d01a8b" returned: 0 in 0.476s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:33 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:47:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:47:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372e8693-180b-4944-b48d-b8bf734a75a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73ff1bf6-8a9c-4a45-8ce2-222f76d01a8b', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc02586-c5aa-4580-9ad9-9f8082c87e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:33 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] Volume volume-73ff1bf6-8a9c-4a45-8ce2-222f76d01a8b (73ff1bf6-8a9c-4a45-8ce2-222f76d01a8b): created successfully Sep 10 19:47:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc02586-c5aa-4580-9ad9-9f8082c87e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] Flow 'volume_create_manager' (35a59516-3e7c-4efd-8b22-cf4d14913484) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:47:33 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-7cbe3f2a-28d4-4c7d-ac16-5751cd74d284 tempest-VolumesListTestJSON-1713815007 None] Created volume successfully. Sep 10 19:47:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-18014442-5edc-4082-a62d-f33167ceabcb tempest-VolumesListTestJSON-1713815007 None] Acquiring lock "cinder-73ff1bf6-8a9c-4a45-8ce2-222f76d01a8b-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:47:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-18014442-5edc-4082-a62d-f33167ceabcb tempest-VolumesListTestJSON-1713815007 None] Lock "cinder-73ff1bf6-8a9c-4a45-8ce2-222f76d01a8b-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:47:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-18014442-5edc-4082-a62d-f33167ceabcb tempest-VolumesListTestJSON-1713815007 None] Acquiring lock "cinder-quobyte-73ff1bf6-8a9c-4a45-8ce2-222f76d01a8b" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:47:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-18014442-5edc-4082-a62d-f33167ceabcb tempest-VolumesListTestJSON-1713815007 None] Lock "cinder-quobyte-73ff1bf6-8a9c-4a45-8ce2-222f76d01a8b" acquired by "delete_volume" :: waited 0.024s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:47:38 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[5080ea34-cf9a-4ed2-8cf7-f31f0c946da0]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:47:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-18014442-5edc-4082-a62d-f33167ceabcb tempest-VolumesListTestJSON-1713815007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-73ff1bf6-8a9c-4a45-8ce2-222f76d01a8b {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:38 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-73ff1bf6-8a9c-4a45-8ce2-222f76d01a8b Sep 10 19:47:38 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:38 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-18014442-5edc-4082-a62d-f33167ceabcb tempest-VolumesListTestJSON-1713815007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-73ff1bf6-8a9c-4a45-8ce2-222f76d01a8b" returned: 0 in 0.573s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-18014442-5edc-4082-a62d-f33167ceabcb tempest-VolumesListTestJSON-1713815007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-73ff1bf6-8a9c-4a45-8ce2-222f76d01a8b {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:38 devstack sudo[93727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-73ff1bf6-8a9c-4a45-8ce2-222f76d01a8b Sep 10 19:47:38 devstack sudo[93727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:38 devstack sudo[93727]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-18014442-5edc-4082-a62d-f33167ceabcb tempest-VolumesListTestJSON-1713815007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-73ff1bf6-8a9c-4a45-8ce2-222f76d01a8b" returned: 0 in 0.359s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:39 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-18014442-5edc-4082-a62d-f33167ceabcb tempest-VolumesListTestJSON-1713815007 None] Lock "cinder-quobyte-73ff1bf6-8a9c-4a45-8ce2-222f76d01a8b" released by "delete_volume" :: held 0.992s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:47:39 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-18014442-5edc-4082-a62d-f33167ceabcb tempest-VolumesListTestJSON-1713815007 None] Created reservations ['c76c586c-36ad-493b-941c-b57a004c79d7', '36854aae-4776-4370-9e90-2666f2acd93c', '8bf732cc-810f-4070-b77d-5bafcf251ec0', 'bc79b993-b4a6-443d-953c-3d1f7da89170'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:47:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-18014442-5edc-4082-a62d-f33167ceabcb tempest-VolumesListTestJSON-1713815007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:47:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-18014442-5edc-4082-a62d-f33167ceabcb tempest-VolumesListTestJSON-1713815007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:47:39 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-18014442-5edc-4082-a62d-f33167ceabcb tempest-VolumesListTestJSON-1713815007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:47:39 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-18014442-5edc-4082-a62d-f33167ceabcb tempest-VolumesListTestJSON-1713815007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:47:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-18014442-5edc-4082-a62d-f33167ceabcb tempest-VolumesListTestJSON-1713815007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:47:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-18014442-5edc-4082-a62d-f33167ceabcb tempest-VolumesListTestJSON-1713815007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:39 devstack sudo[93731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:47:39 devstack sudo[93731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:39 devstack sudo[93731]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-18014442-5edc-4082-a62d-f33167ceabcb tempest-VolumesListTestJSON-1713815007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.397s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:39 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-18014442-5edc-4082-a62d-f33167ceabcb tempest-VolumesListTestJSON-1713815007 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:47:39 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-18014442-5edc-4082-a62d-f33167ceabcb tempest-VolumesListTestJSON-1713815007 None] Deleted volume successfully. Sep 10 19:47:39 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-18014442-5edc-4082-a62d-f33167ceabcb tempest-VolumesListTestJSON-1713815007 None] Lock "cinder-73ff1bf6-8a9c-4a45-8ce2-222f76d01a8b-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:47:40 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-976441fc-6eb4-4821-ad85-dca2cff0ba55 tempest-VolumesListTestJSON-1713815007 None] Acquiring lock "cinder-45e7aa4e-e719-4048-8fa4-2e69c8e274f5-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:47:40 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-976441fc-6eb4-4821-ad85-dca2cff0ba55 tempest-VolumesListTestJSON-1713815007 None] Lock "cinder-45e7aa4e-e719-4048-8fa4-2e69c8e274f5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:47:41 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-976441fc-6eb4-4821-ad85-dca2cff0ba55 tempest-VolumesListTestJSON-1713815007 None] Acquiring lock "cinder-quobyte-45e7aa4e-e719-4048-8fa4-2e69c8e274f5" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:47:41 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-976441fc-6eb4-4821-ad85-dca2cff0ba55 tempest-VolumesListTestJSON-1713815007 None] Lock "cinder-quobyte-45e7aa4e-e719-4048-8fa4-2e69c8e274f5" acquired by "delete_volume" :: waited 0.055s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:47:41 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[d544d480-7f32-4070-a79c-79d0d1a4d068]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:47:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-976441fc-6eb4-4821-ad85-dca2cff0ba55 tempest-VolumesListTestJSON-1713815007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-45e7aa4e-e719-4048-8fa4-2e69c8e274f5 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:41 devstack sudo[93734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-45e7aa4e-e719-4048-8fa4-2e69c8e274f5 Sep 10 19:47:41 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:41 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-976441fc-6eb4-4821-ad85-dca2cff0ba55 tempest-VolumesListTestJSON-1713815007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-45e7aa4e-e719-4048-8fa4-2e69c8e274f5" returned: 0 in 0.519s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-976441fc-6eb4-4821-ad85-dca2cff0ba55 tempest-VolumesListTestJSON-1713815007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-45e7aa4e-e719-4048-8fa4-2e69c8e274f5 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:41 devstack sudo[93739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-45e7aa4e-e719-4048-8fa4-2e69c8e274f5 Sep 10 19:47:41 devstack sudo[93739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:42 devstack sudo[93739]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-976441fc-6eb4-4821-ad85-dca2cff0ba55 tempest-VolumesListTestJSON-1713815007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-45e7aa4e-e719-4048-8fa4-2e69c8e274f5" returned: 0 in 0.644s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:42 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-976441fc-6eb4-4821-ad85-dca2cff0ba55 tempest-VolumesListTestJSON-1713815007 None] Lock "cinder-quobyte-45e7aa4e-e719-4048-8fa4-2e69c8e274f5" released by "delete_volume" :: held 1.284s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:47:42 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-976441fc-6eb4-4821-ad85-dca2cff0ba55 tempest-VolumesListTestJSON-1713815007 None] Created reservations ['e0066d31-5d96-4118-9e9a-a1ad20911506', '1dc6dba6-d2ab-4fd3-9253-5166b2a7d309', '2d31da81-6b51-44eb-a0e4-9d8072b2d847', '0ffdeaf6-68ae-45a6-bc3f-0add673a031f'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:47:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-976441fc-6eb4-4821-ad85-dca2cff0ba55 tempest-VolumesListTestJSON-1713815007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:47:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-976441fc-6eb4-4821-ad85-dca2cff0ba55 tempest-VolumesListTestJSON-1713815007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:47:42 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-976441fc-6eb4-4821-ad85-dca2cff0ba55 tempest-VolumesListTestJSON-1713815007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:47:42 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-976441fc-6eb4-4821-ad85-dca2cff0ba55 tempest-VolumesListTestJSON-1713815007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:47:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-976441fc-6eb4-4821-ad85-dca2cff0ba55 tempest-VolumesListTestJSON-1713815007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:47:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-976441fc-6eb4-4821-ad85-dca2cff0ba55 tempest-VolumesListTestJSON-1713815007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:42 devstack sudo[93763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:47:42 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:43 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-976441fc-6eb4-4821-ad85-dca2cff0ba55 tempest-VolumesListTestJSON-1713815007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.635s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:43 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-976441fc-6eb4-4821-ad85-dca2cff0ba55 tempest-VolumesListTestJSON-1713815007 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:47:43 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-976441fc-6eb4-4821-ad85-dca2cff0ba55 tempest-VolumesListTestJSON-1713815007 None] Deleted volume successfully. Sep 10 19:47:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-976441fc-6eb4-4821-ad85-dca2cff0ba55 tempest-VolumesListTestJSON-1713815007 None] Lock "cinder-45e7aa4e-e719-4048-8fa4-2e69c8e274f5-delete_volume" released by "delete_volume" :: held 2.736s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:47:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a795e1b5-351a-4109-a072-04067a3c30bf tempest-VolumesListTestJSON-1713815007 None] Acquiring lock "cinder-05c1c0fb-ef97-4970-bb54-82735a76cd30-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:47:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a795e1b5-351a-4109-a072-04067a3c30bf tempest-VolumesListTestJSON-1713815007 None] Lock "cinder-05c1c0fb-ef97-4970-bb54-82735a76cd30-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:47:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a795e1b5-351a-4109-a072-04067a3c30bf tempest-VolumesListTestJSON-1713815007 None] Acquiring lock "cinder-quobyte-05c1c0fb-ef97-4970-bb54-82735a76cd30" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:47:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a795e1b5-351a-4109-a072-04067a3c30bf tempest-VolumesListTestJSON-1713815007 None] Lock "cinder-quobyte-05c1c0fb-ef97-4970-bb54-82735a76cd30" acquired by "delete_volume" :: waited 0.058s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:47:44 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d29722-f24a-43ed-a969-19528d8aa435]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:47:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a795e1b5-351a-4109-a072-04067a3c30bf tempest-VolumesListTestJSON-1713815007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-05c1c0fb-ef97-4970-bb54-82735a76cd30 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:44 devstack sudo[93799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-05c1c0fb-ef97-4970-bb54-82735a76cd30 Sep 10 19:47:44 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:44 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a795e1b5-351a-4109-a072-04067a3c30bf tempest-VolumesListTestJSON-1713815007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-05c1c0fb-ef97-4970-bb54-82735a76cd30" returned: 0 in 0.792s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a795e1b5-351a-4109-a072-04067a3c30bf tempest-VolumesListTestJSON-1713815007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-05c1c0fb-ef97-4970-bb54-82735a76cd30 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:45 devstack sudo[93827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-05c1c0fb-ef97-4970-bb54-82735a76cd30 Sep 10 19:47:45 devstack sudo[93827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:45 devstack sudo[93827]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a795e1b5-351a-4109-a072-04067a3c30bf tempest-VolumesListTestJSON-1713815007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-05c1c0fb-ef97-4970-bb54-82735a76cd30" returned: 0 in 0.512s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:45 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a795e1b5-351a-4109-a072-04067a3c30bf tempest-VolumesListTestJSON-1713815007 None] Lock "cinder-quobyte-05c1c0fb-ef97-4970-bb54-82735a76cd30" released by "delete_volume" :: held 1.407s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:47:45 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-a795e1b5-351a-4109-a072-04067a3c30bf tempest-VolumesListTestJSON-1713815007 None] Created reservations ['2fb9d131-8976-4519-a82b-c9fc645f8ce8', '1194eb70-3d12-4c23-aeba-ee3a6e92f4cb', '32df5aca-7ea3-4579-9816-e87fd0964899', '61175357-3ac4-4e99-b359-e0568b80e512'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:47:45 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:47:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] Flow 'volume_create_manager' (973faf19-abe5-49c4-894e-93948c95e326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:47:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db8f7703-350f-4642-8267-c1ee18db8d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db8f7703-350f-4642-8267-c1ee18db8d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1766520632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0a338d7-7352-4282-9314-7aed2fb02fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7daf268f110e4c5dbf2a7d2bb641dbef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:47:46Z,use_quota=True,user_id='f5c9c26053e94b94a2136c037098428b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e0ef542-cf3b-4a72-9855-d4263d5c860d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e0ef542-cf3b-4a72-9855-d4263d5c860d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (269a4394-1a73-461f-b79b-08588d68a380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (269a4394-1a73-461f-b79b-08588d68a380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0a338d7-7352-4282-9314-7aed2fb02fae', 'volume_name': 'volume-b0a338d7-7352-4282-9314-7aed2fb02fae', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (874857ee-37fd-48b8-8dd3-b4e9fda3889f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (874857ee-37fd-48b8-8dd3-b4e9fda3889f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a111f435-90bb-4776-9455-2dc2bdcc7ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:45 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] Volume b0a338d7-7352-4282-9314-7aed2fb02fae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0a338d7-7352-4282-9314-7aed2fb02fae', 'volume_size': 1} Sep 10 19:47:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:47:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:47:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1766520632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0a338d7-7352-4282-9314-7aed2fb02fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7daf268f110e4c5dbf2a7d2bb641dbef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:47:46Z,use_quota=True,user_id='f5c9c26053e94b94a2136c037098428b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:47:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] Creating volume b0a338d7-7352-4282-9314-7aed2fb02fae {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:47:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:47:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:47:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:47:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:47:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:47:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:47:45 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:47:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b0a338d7-7352-4282-9314-7aed2fb02fae 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:45 devstack sudo[93833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b0a338d7-7352-4282-9314-7aed2fb02fae 1073741824 Sep 10 19:47:45 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a795e1b5-351a-4109-a072-04067a3c30bf tempest-VolumesListTestJSON-1713815007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:47:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a795e1b5-351a-4109-a072-04067a3c30bf tempest-VolumesListTestJSON-1713815007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:47:46 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a795e1b5-351a-4109-a072-04067a3c30bf tempest-VolumesListTestJSON-1713815007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:47:46 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a795e1b5-351a-4109-a072-04067a3c30bf tempest-VolumesListTestJSON-1713815007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:47:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a795e1b5-351a-4109-a072-04067a3c30bf tempest-VolumesListTestJSON-1713815007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:47:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a795e1b5-351a-4109-a072-04067a3c30bf tempest-VolumesListTestJSON-1713815007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:46 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:47:46 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:46 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a795e1b5-351a-4109-a072-04067a3c30bf tempest-VolumesListTestJSON-1713815007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.415s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:46 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-a795e1b5-351a-4109-a072-04067a3c30bf tempest-VolumesListTestJSON-1713815007 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:47:46 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-a795e1b5-351a-4109-a072-04067a3c30bf tempest-VolumesListTestJSON-1713815007 None] Deleted volume successfully. Sep 10 19:47:46 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a795e1b5-351a-4109-a072-04067a3c30bf tempest-VolumesListTestJSON-1713815007 None] Lock "cinder-05c1c0fb-ef97-4970-bb54-82735a76cd30-delete_volume" released by "delete_volume" :: held 2.559s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:47:46 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b0a338d7-7352-4282-9314-7aed2fb02fae 1073741824" returned: 0 in 0.810s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b0a338d7-7352-4282-9314-7aed2fb02fae {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:46 devstack sudo[93848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b0a338d7-7352-4282-9314-7aed2fb02fae Sep 10 19:47:46 devstack sudo[93848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:47 devstack sudo[93848]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b0a338d7-7352-4282-9314-7aed2fb02fae" returned: 0 in 0.437s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:47 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:47:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:47:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a111f435-90bb-4776-9455-2dc2bdcc7ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0a338d7-7352-4282-9314-7aed2fb02fae', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6662644-b4c2-48a2-86c0-a10068f3bd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:47 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] Volume volume-b0a338d7-7352-4282-9314-7aed2fb02fae (b0a338d7-7352-4282-9314-7aed2fb02fae): created successfully Sep 10 19:47:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6662644-b4c2-48a2-86c0-a10068f3bd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] Flow 'volume_create_manager' (973faf19-abe5-49c4-894e-93948c95e326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:47:47 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-5bb27e25-63d9-4383-905c-c1fcf648ef7a tempest-AttachVolumeNegativeTest-2048411806 None] Created volume successfully. Sep 10 19:47:49 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:UPDATE=84,cinder:SELECT=54,cinder:DELETE=8,cinder:INSERT=20 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:47:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-2fd77d0a-aac6-4a1b-9154-f0e9b8144ed6 req-3127b063-8ba0-49e0-8a74-61ff627525d9 tempest-AttachVolumeNegativeTest-2048411806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:47:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-2fd77d0a-aac6-4a1b-9154-f0e9b8144ed6 req-3127b063-8ba0-49e0-8a74-61ff627525d9 tempest-AttachVolumeNegativeTest-2048411806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:47:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-2fd77d0a-aac6-4a1b-9154-f0e9b8144ed6 req-3127b063-8ba0-49e0-8a74-61ff627525d9 tempest-AttachVolumeNegativeTest-2048411806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:47:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-2fd77d0a-aac6-4a1b-9154-f0e9b8144ed6 req-3127b063-8ba0-49e0-8a74-61ff627525d9 tempest-AttachVolumeNegativeTest-2048411806 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3', 'name': 'volume-b0a338d7-7352-4282-9314-7aed2fb02fae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '805f1272-953d-41e2-a0c1-b66001018da0', 'enforce_multipath': True} {{(pid=88093) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 19:47:49 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-2fd77d0a-aac6-4a1b-9154-f0e9b8144ed6 req-3127b063-8ba0-49e0-8a74-61ff627525d9 tempest-AttachVolumeNegativeTest-2048411806 None] attachment_update completed successfully. Sep 10 19:47:51 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:47:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] Flow 'volume_create_manager' (48e1b726-913c-4273-b5c4-ea99ab4123c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:47:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (455b5a2c-ff34-4a72-828d-3a9d196ec7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (455b5a2c-ff34-4a72-828d-3a9d196ec7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1600484290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ef0f7ca-83e8-4719-9619-fe78019e4f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf4c609352e4fe0b61452fb6494d507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:47:52Z,use_quota=True,user_id='1ce9b18feeda447995febec0c336bd48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a815305-4e81-493d-b745-2a78f82eed89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a815305-4e81-493d-b745-2a78f82eed89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c63254-c930-4734-91a3-99b8e7a5b21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c63254-c930-4734-91a3-99b8e7a5b21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ef0f7ca-83e8-4719-9619-fe78019e4f18', 'volume_name': 'volume-3ef0f7ca-83e8-4719-9619-fe78019e4f18', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12672cca-f9a9-427f-917a-238e19b0ff2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12672cca-f9a9-427f-917a-238e19b0ff2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be64417-6a4e-4135-a17d-a4084ef03087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:51 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] Volume 3ef0f7ca-83e8-4719-9619-fe78019e4f18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ef0f7ca-83e8-4719-9619-fe78019e4f18', 'volume_size': 1} Sep 10 19:47:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:47:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:47:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1600484290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ef0f7ca-83e8-4719-9619-fe78019e4f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf4c609352e4fe0b61452fb6494d507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:47:52Z,use_quota=True,user_id='1ce9b18feeda447995febec0c336bd48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:47:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] Creating volume 3ef0f7ca-83e8-4719-9619-fe78019e4f18 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:47:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:47:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:47:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:47:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:47:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:47:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:47:51 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:47:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3ef0f7ca-83e8-4719-9619-fe78019e4f18 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:52 devstack sudo[94276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3ef0f7ca-83e8-4719-9619-fe78019e4f18 1073741824 Sep 10 19:47:52 devstack sudo[94276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:52 devstack sudo[94276]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3ef0f7ca-83e8-4719-9619-fe78019e4f18 1073741824" returned: 0 in 0.668s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3ef0f7ca-83e8-4719-9619-fe78019e4f18 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:52 devstack sudo[94284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3ef0f7ca-83e8-4719-9619-fe78019e4f18 Sep 10 19:47:52 devstack sudo[94284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] Flow 'volume_create_manager' (8c97cd99-9d34-48eb-ab18-1414491bc0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:47:53 devstack sudo[94284]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec20f24-1ff0-4d8e-8efe-5513f57a0a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3ef0f7ca-83e8-4719-9619-fe78019e4f18" returned: 0 in 0.412s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be64417-6a4e-4135-a17d-a4084ef03087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ef0f7ca-83e8-4719-9619-fe78019e4f18', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90784c3-ed90-4d4b-b705-1191c927fcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec20f24-1ff0-4d8e-8efe-5513f57a0a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1838938243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24717d6e-a9ed-497c-abe8-800f3f017573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f72071a4dc47d68e3245bc68f69ad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:47:53Z,use_quota=True,user_id='077906d9893349698bcdb8420ee9b047',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb9c0db6-85e7-43f7-b9b5-4b8a5ab4838b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb9c0db6-85e7-43f7-b9b5-4b8a5ab4838b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90e6d1b2-f780-494d-8e68-85025b9154d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90e6d1b2-f780-494d-8e68-85025b9154d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24717d6e-a9ed-497c-abe8-800f3f017573', 'volume_name': 'volume-24717d6e-a9ed-497c-abe8-800f3f017573', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bead90d-21d0-43f1-a3a5-fff15d8bd6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bead90d-21d0-43f1-a3a5-fff15d8bd6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f274de-dd1c-469a-ba29-3f8b70b18456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:53 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] Volume 24717d6e-a9ed-497c-abe8-800f3f017573: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24717d6e-a9ed-497c-abe8-800f3f017573', 'volume_size': 1} Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1838938243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24717d6e-a9ed-497c-abe8-800f3f017573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f72071a4dc47d68e3245bc68f69ad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:47:53Z,use_quota=True,user_id='077906d9893349698bcdb8420ee9b047',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] Creating volume 24717d6e-a9ed-497c-abe8-800f3f017573 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:47:53 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-24717d6e-a9ed-497c-abe8-800f3f017573 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:53 devstack sudo[94315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-24717d6e-a9ed-497c-abe8-800f3f017573 1073741824 Sep 10 19:47:53 devstack sudo[94315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:53 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] Volume volume-3ef0f7ca-83e8-4719-9619-fe78019e4f18 (3ef0f7ca-83e8-4719-9619-fe78019e4f18): created successfully Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90784c3-ed90-4d4b-b705-1191c927fcfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] Flow 'volume_create_manager' (48e1b726-913c-4273-b5c4-ea99ab4123c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:47:53 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-a572799b-b61d-4c4c-b878-e09fb304d117 tempest-ServersNegativeTestJSON-1192410553 None] Created volume successfully. Sep 10 19:47:53 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-5f4d5f44-0c9d-488a-9fdd-56211dc4925c req-f3d1af3d-ab26-4a95-9dc5-b1fc99894855 tempest-AttachVolumeNegativeTest-2048411806 None] Terminate volume connection completed successfully. Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-5f4d5f44-0c9d-488a-9fdd-56211dc4925c req-f3d1af3d-ab26-4a95-9dc5-b1fc99894855 tempest-AttachVolumeNegativeTest-2048411806 None] Deleting attachment 805f1272-953d-41e2-a0c1-b66001018da0. {{(pid=88093) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 19:47:53 devstack sudo[94315]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-24717d6e-a9ed-497c-abe8-800f3f017573 1073741824" returned: 0 in 0.602s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-24717d6e-a9ed-497c-abe8-800f3f017573 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:54 devstack sudo[94332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-24717d6e-a9ed-497c-abe8-800f3f017573 Sep 10 19:47:54 devstack sudo[94332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:54 devstack sudo[94332]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-24717d6e-a9ed-497c-abe8-800f3f017573" returned: 0 in 0.547s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:54 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:47:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:47:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f274de-dd1c-469a-ba29-3f8b70b18456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24717d6e-a9ed-497c-abe8-800f3f017573', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79df6cdd-5f98-420e-a859-1d0a6453c1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:54 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] Volume volume-24717d6e-a9ed-497c-abe8-800f3f017573 (24717d6e-a9ed-497c-abe8-800f3f017573): created successfully Sep 10 19:47:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79df6cdd-5f98-420e-a859-1d0a6453c1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] Flow 'volume_create_manager' (8c97cd99-9d34-48eb-ab18-1414491bc0d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:47:54 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-e7a8daf5-785a-48ec-a69a-53770eaebe3f tempest-VolumesNegativeTest-1237666613 None] Created volume successfully. Sep 10 19:47:58 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:47:58 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] Flow 'volume_create_manager' (4492c352-8f8d-498b-9e45-116a00806c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:47:58 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e13eef72-452b-4cb5-aa75-4cb7b816550b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:58 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e13eef72-452b-4cb5-aa75-4cb7b816550b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1902464207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a47fe64b-3543-45e5-93f8-3c87420cf503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf4c609352e4fe0b61452fb6494d507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:47:58Z,use_quota=True,user_id='1ce9b18feeda447995febec0c336bd48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:58 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57bf3297-27bf-4d11-a439-c26d9720d484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:58 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57bf3297-27bf-4d11-a439-c26d9720d484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:58 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97e40dd2-5ac1-4bbd-8937-c8e18553984e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:58 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97e40dd2-5ac1-4bbd-8937-c8e18553984e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a47fe64b-3543-45e5-93f8-3c87420cf503', 'volume_name': 'volume-a47fe64b-3543-45e5-93f8-3c87420cf503', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:58 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f32c7e-352c-4010-b55b-9a6551654a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:58 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f32c7e-352c-4010-b55b-9a6551654a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:47:58 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c144a408-0fe0-45c0-bd34-ea1c417311a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:47:58 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] Volume a47fe64b-3543-45e5-93f8-3c87420cf503: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a47fe64b-3543-45e5-93f8-3c87420cf503', 'volume_size': 1} Sep 10 19:47:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:47:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:47:58 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1902464207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a47fe64b-3543-45e5-93f8-3c87420cf503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf4c609352e4fe0b61452fb6494d507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:47:58Z,use_quota=True,user_id='1ce9b18feeda447995febec0c336bd48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:47:58 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] Creating volume a47fe64b-3543-45e5-93f8-3c87420cf503 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:47:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:47:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:47:58 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:47:58 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:47:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:47:58 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:47:58 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:47:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a47fe64b-3543-45e5-93f8-3c87420cf503 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:58 devstack sudo[94431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a47fe64b-3543-45e5-93f8-3c87420cf503 1073741824 Sep 10 19:47:58 devstack sudo[94431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:47:59 devstack sudo[94431]: pam_unix(sudo:session): session closed for user root Sep 10 19:47:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a47fe64b-3543-45e5-93f8-3c87420cf503 1073741824" returned: 0 in 0.679s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:47:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a47fe64b-3543-45e5-93f8-3c87420cf503 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:47:59 devstack sudo[94440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a47fe64b-3543-45e5-93f8-3c87420cf503 Sep 10 19:47:59 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:48:00 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root Sep 10 19:48:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a47fe64b-3543-45e5-93f8-3c87420cf503" returned: 0 in 0.662s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:48:00 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:48:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:48:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c144a408-0fe0-45c0-bd34-ea1c417311a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a47fe64b-3543-45e5-93f8-3c87420cf503', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:48:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bfc559c-b9db-4311-8dc7-547d89372fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:48:00 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] Volume volume-a47fe64b-3543-45e5-93f8-3c87420cf503 (a47fe64b-3543-45e5-93f8-3c87420cf503): created successfully Sep 10 19:48:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bfc559c-b9db-4311-8dc7-547d89372fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:48:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] Flow 'volume_create_manager' (4492c352-8f8d-498b-9e45-116a00806c50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:48:00 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-5c22f5eb-0d19-4b60-8037-8f34fa4f1fe6 tempest-ServersNegativeTestJSON-1192410553 None] Created volume successfully. Sep 10 19:48:02 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f17227e0-da88-404b-b35f-56f888fea188 tempest-ServersNegativeTestJSON-1192410553 None] Acquiring lock "cinder-a47fe64b-3543-45e5-93f8-3c87420cf503-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:48:02 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f17227e0-da88-404b-b35f-56f888fea188 tempest-ServersNegativeTestJSON-1192410553 None] Lock "cinder-a47fe64b-3543-45e5-93f8-3c87420cf503-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:48:02 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f17227e0-da88-404b-b35f-56f888fea188 tempest-ServersNegativeTestJSON-1192410553 None] Acquiring lock "cinder-quobyte-a47fe64b-3543-45e5-93f8-3c87420cf503" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:48:02 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f17227e0-da88-404b-b35f-56f888fea188 tempest-ServersNegativeTestJSON-1192410553 None] Lock "cinder-quobyte-a47fe64b-3543-45e5-93f8-3c87420cf503" acquired by "delete_volume" :: waited 0.023s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:48:02 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bc380e-bb5a-4d36-9cde-a117b55d6fe2]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:48:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f17227e0-da88-404b-b35f-56f888fea188 tempest-ServersNegativeTestJSON-1192410553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a47fe64b-3543-45e5-93f8-3c87420cf503 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:48:02 devstack sudo[94462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a47fe64b-3543-45e5-93f8-3c87420cf503 Sep 10 19:48:02 devstack sudo[94462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:48:02 devstack sudo[94462]: pam_unix(sudo:session): session closed for user root Sep 10 19:48:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f17227e0-da88-404b-b35f-56f888fea188 tempest-ServersNegativeTestJSON-1192410553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a47fe64b-3543-45e5-93f8-3c87420cf503" returned: 0 in 0.556s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:48:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f17227e0-da88-404b-b35f-56f888fea188 tempest-ServersNegativeTestJSON-1192410553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a47fe64b-3543-45e5-93f8-3c87420cf503 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:48:02 devstack sudo[94467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a47fe64b-3543-45e5-93f8-3c87420cf503 Sep 10 19:48:02 devstack sudo[94467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:48:03 devstack sudo[94467]: pam_unix(sudo:session): session closed for user root Sep 10 19:48:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f17227e0-da88-404b-b35f-56f888fea188 tempest-ServersNegativeTestJSON-1192410553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a47fe64b-3543-45e5-93f8-3c87420cf503" returned: 0 in 0.309s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:48:03 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f17227e0-da88-404b-b35f-56f888fea188 tempest-ServersNegativeTestJSON-1192410553 None] Lock "cinder-quobyte-a47fe64b-3543-45e5-93f8-3c87420cf503" released by "delete_volume" :: held 0.963s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:48:03 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-f17227e0-da88-404b-b35f-56f888fea188 tempest-ServersNegativeTestJSON-1192410553 None] Created reservations ['7c1ba56e-55bf-4cd5-b4b2-0fe85a70e9e9', '2e757c31-758a-4e7d-9dbf-fe64a22cb1c5', '1ebba704-b33e-4649-8484-ec78b3e79438', '3a80b0c7-0bba-4f0f-a021-bfbb40f49f6a'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:48:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f17227e0-da88-404b-b35f-56f888fea188 tempest-ServersNegativeTestJSON-1192410553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:48:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f17227e0-da88-404b-b35f-56f888fea188 tempest-ServersNegativeTestJSON-1192410553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:48:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f17227e0-da88-404b-b35f-56f888fea188 tempest-ServersNegativeTestJSON-1192410553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:48:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f17227e0-da88-404b-b35f-56f888fea188 tempest-ServersNegativeTestJSON-1192410553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:48:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f17227e0-da88-404b-b35f-56f888fea188 tempest-ServersNegativeTestJSON-1192410553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:48:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f17227e0-da88-404b-b35f-56f888fea188 tempest-ServersNegativeTestJSON-1192410553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:48:03 devstack sudo[94470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:48:03 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:48:03 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5c29454b-d0e8-4041-905f-e2aa9649d226 tempest-ServersNegativeTestJSON-1192410553 None] Acquiring lock "cinder-3ef0f7ca-83e8-4719-9619-fe78019e4f18-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:48:03 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5c29454b-d0e8-4041-905f-e2aa9649d226 tempest-ServersNegativeTestJSON-1192410553 None] Lock "cinder-3ef0f7ca-83e8-4719-9619-fe78019e4f18-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:48:03 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5c29454b-d0e8-4041-905f-e2aa9649d226 tempest-ServersNegativeTestJSON-1192410553 None] Acquiring lock "cinder-quobyte-3ef0f7ca-83e8-4719-9619-fe78019e4f18" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:48:03 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5c29454b-d0e8-4041-905f-e2aa9649d226 tempest-ServersNegativeTestJSON-1192410553 None] Lock "cinder-quobyte-3ef0f7ca-83e8-4719-9619-fe78019e4f18" acquired by "delete_volume" :: waited 0.037s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:48:03 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[a465508a-8c0b-48fa-8f98-feb810dbe703]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:48:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5c29454b-d0e8-4041-905f-e2aa9649d226 tempest-ServersNegativeTestJSON-1192410553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3ef0f7ca-83e8-4719-9619-fe78019e4f18 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:48:03 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:48:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:48:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:48:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:48:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:48:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:48:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:48:03 devstack sudo[94474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:48:03 devstack sudo[94474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:48:03 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root Sep 10 19:48:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f17227e0-da88-404b-b35f-56f888fea188 tempest-ServersNegativeTestJSON-1192410553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.550s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:48:03 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-f17227e0-da88-404b-b35f-56f888fea188 tempest-ServersNegativeTestJSON-1192410553 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:48:03 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-f17227e0-da88-404b-b35f-56f888fea188 tempest-ServersNegativeTestJSON-1192410553 None] Deleted volume successfully. Sep 10 19:48:03 devstack sudo[94472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3ef0f7ca-83e8-4719-9619-fe78019e4f18 Sep 10 19:48:03 devstack sudo[94472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:48:04 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f17227e0-da88-404b-b35f-56f888fea188 tempest-ServersNegativeTestJSON-1192410553 None] Lock "cinder-a47fe64b-3543-45e5-93f8-3c87420cf503-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:48:04 devstack sudo[94474]: pam_unix(sudo:session): session closed for user root Sep 10 19:48:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.541s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:48:04 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:48:04 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager._thread_info {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:48:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread count: 28 {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 19:48:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread info: [<_MainThread(MainThread, started 138417491665024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 19:48:04 devstack sudo[94472]: pam_unix(sudo:session): session closed for user root Sep 10 19:48:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5c29454b-d0e8-4041-905f-e2aa9649d226 tempest-ServersNegativeTestJSON-1192410553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3ef0f7ca-83e8-4719-9619-fe78019e4f18" returned: 0 in 0.698s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:48:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5c29454b-d0e8-4041-905f-e2aa9649d226 tempest-ServersNegativeTestJSON-1192410553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3ef0f7ca-83e8-4719-9619-fe78019e4f18 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:48:04 devstack sudo[94482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3ef0f7ca-83e8-4719-9619-fe78019e4f18 Sep 10 19:48:04 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:48:04 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root Sep 10 19:48:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5c29454b-d0e8-4041-905f-e2aa9649d226 tempest-ServersNegativeTestJSON-1192410553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3ef0f7ca-83e8-4719-9619-fe78019e4f18" returned: 0 in 0.488s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:48:04 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5c29454b-d0e8-4041-905f-e2aa9649d226 tempest-ServersNegativeTestJSON-1192410553 None] Lock "cinder-quobyte-3ef0f7ca-83e8-4719-9619-fe78019e4f18" released by "delete_volume" :: held 1.262s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:48:05 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-5c29454b-d0e8-4041-905f-e2aa9649d226 tempest-ServersNegativeTestJSON-1192410553 None] Created reservations ['aff52c47-9239-49af-9a27-cad845410952', '026a1f2b-caa1-4e9a-977e-5b713541decf', '21092f82-acc2-49e6-a2d6-833bdc1dd846', '22c74816-08cd-4182-bc27-55876595e2fc'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:48:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5c29454b-d0e8-4041-905f-e2aa9649d226 tempest-ServersNegativeTestJSON-1192410553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:48:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5c29454b-d0e8-4041-905f-e2aa9649d226 tempest-ServersNegativeTestJSON-1192410553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:48:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5c29454b-d0e8-4041-905f-e2aa9649d226 tempest-ServersNegativeTestJSON-1192410553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:48:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5c29454b-d0e8-4041-905f-e2aa9649d226 tempest-ServersNegativeTestJSON-1192410553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:48:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5c29454b-d0e8-4041-905f-e2aa9649d226 tempest-ServersNegativeTestJSON-1192410553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:48:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5c29454b-d0e8-4041-905f-e2aa9649d226 tempest-ServersNegativeTestJSON-1192410553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:48:05 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:48:05 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:48:05 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Sep 10 19:48:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5c29454b-d0e8-4041-905f-e2aa9649d226 tempest-ServersNegativeTestJSON-1192410553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.491s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:48:05 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-5c29454b-d0e8-4041-905f-e2aa9649d226 tempest-ServersNegativeTestJSON-1192410553 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:48:05 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-5c29454b-d0e8-4041-905f-e2aa9649d226 tempest-ServersNegativeTestJSON-1192410553 None] Deleted volume successfully. Sep 10 19:48:05 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5c29454b-d0e8-4041-905f-e2aa9649d226 tempest-ServersNegativeTestJSON-1192410553 None] Lock "cinder-3ef0f7ca-83e8-4719-9619-fe78019e4f18-delete_volume" released by "delete_volume" :: held 2.195s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:48:15 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=53,cinder:UPDATE=62,cinder:INSERT=12,cinder:DELETE=4 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:48:15 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=17,cinder:UPDATE=26,cinder:INSERT=6,cinder:DELETE=3 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:48:24 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-183c34ba-f2ca-4ffe-bba6-bc878f654b70 tempest-VolumesNegativeTest-1237666613 None] Acquiring lock "cinder-24717d6e-a9ed-497c-abe8-800f3f017573-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:48:24 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-183c34ba-f2ca-4ffe-bba6-bc878f654b70 tempest-VolumesNegativeTest-1237666613 None] Lock "cinder-24717d6e-a9ed-497c-abe8-800f3f017573-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:48:24 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-183c34ba-f2ca-4ffe-bba6-bc878f654b70 tempest-VolumesNegativeTest-1237666613 None] Acquiring lock "cinder-quobyte-24717d6e-a9ed-497c-abe8-800f3f017573" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:48:24 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-183c34ba-f2ca-4ffe-bba6-bc878f654b70 tempest-VolumesNegativeTest-1237666613 None] Lock "cinder-quobyte-24717d6e-a9ed-497c-abe8-800f3f017573" acquired by "delete_volume" :: waited 0.032s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:48:25 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35e217c-f2f7-48b8-a25e-1dd3b9069957]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:48:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-183c34ba-f2ca-4ffe-bba6-bc878f654b70 tempest-VolumesNegativeTest-1237666613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-24717d6e-a9ed-497c-abe8-800f3f017573 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:48:25 devstack sudo[94767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-24717d6e-a9ed-497c-abe8-800f3f017573 Sep 10 19:48:25 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:48:25 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root Sep 10 19:48:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-183c34ba-f2ca-4ffe-bba6-bc878f654b70 tempest-VolumesNegativeTest-1237666613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-24717d6e-a9ed-497c-abe8-800f3f017573" returned: 0 in 0.527s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:48:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-183c34ba-f2ca-4ffe-bba6-bc878f654b70 tempest-VolumesNegativeTest-1237666613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-24717d6e-a9ed-497c-abe8-800f3f017573 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:48:25 devstack sudo[94773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-24717d6e-a9ed-497c-abe8-800f3f017573 Sep 10 19:48:25 devstack sudo[94773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:48:25 devstack sudo[94773]: pam_unix(sudo:session): session closed for user root Sep 10 19:48:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-183c34ba-f2ca-4ffe-bba6-bc878f654b70 tempest-VolumesNegativeTest-1237666613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-24717d6e-a9ed-497c-abe8-800f3f017573" returned: 0 in 0.360s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:48:25 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-183c34ba-f2ca-4ffe-bba6-bc878f654b70 tempest-VolumesNegativeTest-1237666613 None] Lock "cinder-quobyte-24717d6e-a9ed-497c-abe8-800f3f017573" released by "delete_volume" :: held 0.958s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:48:26 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-183c34ba-f2ca-4ffe-bba6-bc878f654b70 tempest-VolumesNegativeTest-1237666613 None] Created reservations ['af4326f6-98ee-45f2-8259-5048c1c2cbbf', '44a10d92-2133-4c82-88f2-3cd6bf3a4ec8', '065ac20e-748c-4f1e-832a-daf5c4b5142e', 'e3261b4c-f2f1-479e-aa21-032d843496a5'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:48:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-183c34ba-f2ca-4ffe-bba6-bc878f654b70 tempest-VolumesNegativeTest-1237666613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:48:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-183c34ba-f2ca-4ffe-bba6-bc878f654b70 tempest-VolumesNegativeTest-1237666613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:48:26 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-183c34ba-f2ca-4ffe-bba6-bc878f654b70 tempest-VolumesNegativeTest-1237666613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:48:26 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-183c34ba-f2ca-4ffe-bba6-bc878f654b70 tempest-VolumesNegativeTest-1237666613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:48:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-183c34ba-f2ca-4ffe-bba6-bc878f654b70 tempest-VolumesNegativeTest-1237666613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:48:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-183c34ba-f2ca-4ffe-bba6-bc878f654b70 tempest-VolumesNegativeTest-1237666613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:48:26 devstack sudo[94776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:48:26 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:48:26 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root Sep 10 19:48:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-183c34ba-f2ca-4ffe-bba6-bc878f654b70 tempest-VolumesNegativeTest-1237666613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.310s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:48:26 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-183c34ba-f2ca-4ffe-bba6-bc878f654b70 tempest-VolumesNegativeTest-1237666613 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:48:26 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-183c34ba-f2ca-4ffe-bba6-bc878f654b70 tempest-VolumesNegativeTest-1237666613 None] Deleted volume successfully. Sep 10 19:48:26 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-183c34ba-f2ca-4ffe-bba6-bc878f654b70 tempest-VolumesNegativeTest-1237666613 None] Lock "cinder-24717d6e-a9ed-497c-abe8-800f3f017573-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:48:28 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:48:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] Flow 'volume_create_manager' (750e178d-ddc9-4b3a-9523-dc163aea132a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:48:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (037ece3c-43f2-4b0e-840a-8565042cb897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:48:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (037ece3c-43f2-4b0e-840a-8565042cb897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-963586848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac741a23-726e-4740-987c-1960ae1fd7ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30561af7b5ab4c8fa4e42ad314a7e625',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:48:28Z,use_quota=True,user_id='83ebc268eb3845f2b4f59b830f984e12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:48:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60754bb5-a7e5-446f-af1a-f216558cca78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:48:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60754bb5-a7e5-446f-af1a-f216558cca78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:48:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad7992b-22cd-4928-951e-16a169118fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:48:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad7992b-22cd-4928-951e-16a169118fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac741a23-726e-4740-987c-1960ae1fd7ad', 'volume_name': 'volume-ac741a23-726e-4740-987c-1960ae1fd7ad', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:48:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a92479b8-ec65-471d-833a-4c26d211c4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:48:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a92479b8-ec65-471d-833a-4c26d211c4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:48:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b154678-1dbe-46df-be33-7f1e4449d7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:48:28 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] Volume ac741a23-726e-4740-987c-1960ae1fd7ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac741a23-726e-4740-987c-1960ae1fd7ad', 'volume_size': 1} Sep 10 19:48:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:48:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:48:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-963586848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac741a23-726e-4740-987c-1960ae1fd7ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30561af7b5ab4c8fa4e42ad314a7e625',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:48:28Z,use_quota=True,user_id='83ebc268eb3845f2b4f59b830f984e12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:48:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] Creating volume ac741a23-726e-4740-987c-1960ae1fd7ad {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:48:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:48:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:48:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:48:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:48:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:48:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:48:28 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:48:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac741a23-726e-4740-987c-1960ae1fd7ad 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:48:28 devstack sudo[94781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac741a23-726e-4740-987c-1960ae1fd7ad 1073741824 Sep 10 19:48:28 devstack sudo[94781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:48:28 devstack sudo[94781]: pam_unix(sudo:session): session closed for user root Sep 10 19:48:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac741a23-726e-4740-987c-1960ae1fd7ad 1073741824" returned: 0 in 0.637s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:48:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac741a23-726e-4740-987c-1960ae1fd7ad {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:48:29 devstack sudo[94787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac741a23-726e-4740-987c-1960ae1fd7ad Sep 10 19:48:29 devstack sudo[94787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:48:29 devstack sudo[94787]: pam_unix(sudo:session): session closed for user root Sep 10 19:48:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac741a23-726e-4740-987c-1960ae1fd7ad" returned: 0 in 0.436s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:48:29 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:48:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:48:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b154678-1dbe-46df-be33-7f1e4449d7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac741a23-726e-4740-987c-1960ae1fd7ad', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:48:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (115d281c-4659-41d1-98af-9f7dafdbee1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:48:29 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] Volume volume-ac741a23-726e-4740-987c-1960ae1fd7ad (ac741a23-726e-4740-987c-1960ae1fd7ad): created successfully Sep 10 19:48:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (115d281c-4659-41d1-98af-9f7dafdbee1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:48:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] Flow 'volume_create_manager' (750e178d-ddc9-4b3a-9523-dc163aea132a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:48:29 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-6d8a6ab1-30b8-4b9c-afc3-523715a3718d tempest-AttachVolumeShelveTestJSON-1569531410 None] Created volume successfully. Sep 10 19:48:39 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=7,cinder:UPDATE=11,cinder:INSERT=3 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:48:39 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=11,cinder:DELETE=2 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:48:43 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:48:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] Flow 'volume_create_manager' (15096273-51ec-4ba2-abfb-368f5f8518c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:48:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3750bd62-2661-48cc-820a-e9209c81e78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:48:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3750bd62-2661-48cc-820a-e9209c81e78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-833348655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6095227-4d1c-4bf4-879d-b4bef54b5d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7daf268f110e4c5dbf2a7d2bb641dbef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:48:44Z,use_quota=True,user_id='f5c9c26053e94b94a2136c037098428b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:48:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eafada9-10a2-4a50-a8b7-61842cdace0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:48:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eafada9-10a2-4a50-a8b7-61842cdace0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:48:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76540ae4-5a7e-4c85-bd96-540c3d61d83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:48:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76540ae4-5a7e-4c85-bd96-540c3d61d83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6095227-4d1c-4bf4-879d-b4bef54b5d4f', 'volume_name': 'volume-d6095227-4d1c-4bf4-879d-b4bef54b5d4f', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:48:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9921b1a8-975f-4f23-9e67-f14248f05722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:48:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9921b1a8-975f-4f23-9e67-f14248f05722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:48:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ae654b9-561d-4eb0-980d-346567e473f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:48:43 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] Volume d6095227-4d1c-4bf4-879d-b4bef54b5d4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6095227-4d1c-4bf4-879d-b4bef54b5d4f', 'volume_size': 1} Sep 10 19:48:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:48:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:48:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-833348655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6095227-4d1c-4bf4-879d-b4bef54b5d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7daf268f110e4c5dbf2a7d2bb641dbef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:48:44Z,use_quota=True,user_id='f5c9c26053e94b94a2136c037098428b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:48:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] Creating volume d6095227-4d1c-4bf4-879d-b4bef54b5d4f {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:48:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:48:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:48:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:48:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:48:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:48:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:48:43 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:48:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d6095227-4d1c-4bf4-879d-b4bef54b5d4f 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:48:43 devstack sudo[94861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d6095227-4d1c-4bf4-879d-b4bef54b5d4f 1073741824 Sep 10 19:48:43 devstack sudo[94861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:48:44 devstack sudo[94861]: pam_unix(sudo:session): session closed for user root Sep 10 19:48:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d6095227-4d1c-4bf4-879d-b4bef54b5d4f 1073741824" returned: 0 in 0.664s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:48:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d6095227-4d1c-4bf4-879d-b4bef54b5d4f {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:48:44 devstack sudo[94869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d6095227-4d1c-4bf4-879d-b4bef54b5d4f Sep 10 19:48:44 devstack sudo[94869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:48:45 devstack sudo[94869]: pam_unix(sudo:session): session closed for user root Sep 10 19:48:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d6095227-4d1c-4bf4-879d-b4bef54b5d4f" returned: 0 in 0.361s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:48:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:48:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:48:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ae654b9-561d-4eb0-980d-346567e473f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6095227-4d1c-4bf4-879d-b4bef54b5d4f', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:48:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed7289b1-c2ed-4b93-9f67-b6b4acdb675b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:48:45 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] Volume volume-d6095227-4d1c-4bf4-879d-b4bef54b5d4f (d6095227-4d1c-4bf4-879d-b4bef54b5d4f): created successfully Sep 10 19:48:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed7289b1-c2ed-4b93-9f67-b6b4acdb675b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:48:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] Flow 'volume_create_manager' (15096273-51ec-4ba2-abfb-368f5f8518c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:48:45 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-0da38493-4970-480c-8e0e-4403203af43f tempest-AttachVolumeNegativeTest-2048411806 None] Created volume successfully. Sep 10 19:48:46 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-c6417efa-c73e-4666-8e9e-83ac34495e35 req-17945605-cf89-4a0f-98b3-96740b9934ee tempest-AttachVolumeShelveTestJSON-1569531410 None] No connector for attachment ec3947c0-5461-49ee-a3cc-563e4b310739; skipping storage backend terminate_connection call. {{(pid=88093) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 10 19:48:46 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-c6417efa-c73e-4666-8e9e-83ac34495e35 req-17945605-cf89-4a0f-98b3-96740b9934ee tempest-AttachVolumeShelveTestJSON-1569531410 None] Deleting attachment ec3947c0-5461-49ee-a3cc-563e4b310739. {{(pid=88093) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 19:48:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-faa76830-676c-4a00-8ba0-fc6a6cb51790 req-7af7c6c3-e8fd-4116-bfe2-351488924ff0 tempest-AttachVolumeNegativeTest-2048411806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:48:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-faa76830-676c-4a00-8ba0-fc6a6cb51790 req-7af7c6c3-e8fd-4116-bfe2-351488924ff0 tempest-AttachVolumeNegativeTest-2048411806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:48:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-faa76830-676c-4a00-8ba0-fc6a6cb51790 req-7af7c6c3-e8fd-4116-bfe2-351488924ff0 tempest-AttachVolumeNegativeTest-2048411806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:48:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-faa76830-676c-4a00-8ba0-fc6a6cb51790 req-7af7c6c3-e8fd-4116-bfe2-351488924ff0 tempest-AttachVolumeNegativeTest-2048411806 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3', 'name': 'volume-d6095227-4d1c-4bf4-879d-b4bef54b5d4f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f8a96c90-2977-4843-b6bc-33c7103fb37a', 'enforce_multipath': True} {{(pid=88093) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 19:48:47 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-faa76830-676c-4a00-8ba0-fc6a6cb51790 req-7af7c6c3-e8fd-4116-bfe2-351488924ff0 tempest-AttachVolumeNegativeTest-2048411806 None] attachment_update completed successfully. Sep 10 19:48:50 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-0ff8acfd-4bc0-4318-9b9c-a655e8e0f85c req-0d603285-f9d4-4db7-b6ab-27bf29ab7c66 tempest-AttachVolumeNegativeTest-2048411806 None] Terminate volume connection completed successfully. Sep 10 19:48:50 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-0ff8acfd-4bc0-4318-9b9c-a655e8e0f85c req-0d603285-f9d4-4db7-b6ab-27bf29ab7c66 tempest-AttachVolumeNegativeTest-2048411806 None] Deleting attachment f8a96c90-2977-4843-b6bc-33c7103fb37a. {{(pid=88093) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 19:49:00 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=13,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:49:00 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:49:03 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:49:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:49:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:49:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:49:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:49:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:49:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:03 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:49:03 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:04 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c667f69e-9603-4335-9bf4-1b0425f15dd8 tempest-AttachVolumeNegativeTest-2048411806 None] Acquiring lock "cinder-d6095227-4d1c-4bf4-879d-b4bef54b5d4f-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:49:04 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c667f69e-9603-4335-9bf4-1b0425f15dd8 tempest-AttachVolumeNegativeTest-2048411806 None] Lock "cinder-d6095227-4d1c-4bf4-879d-b4bef54b5d4f-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:49:04 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c667f69e-9603-4335-9bf4-1b0425f15dd8 tempest-AttachVolumeNegativeTest-2048411806 None] Acquiring lock "cinder-quobyte-d6095227-4d1c-4bf4-879d-b4bef54b5d4f" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:49:04 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c667f69e-9603-4335-9bf4-1b0425f15dd8 tempest-AttachVolumeNegativeTest-2048411806 None] Lock "cinder-quobyte-d6095227-4d1c-4bf4-879d-b4bef54b5d4f" acquired by "delete_volume" :: waited 0.044s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:49:04 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3276d12-de4c-47d4-82ba-200beee6cf0c]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:49:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c667f69e-9603-4335-9bf4-1b0425f15dd8 tempest-AttachVolumeNegativeTest-2048411806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d6095227-4d1c-4bf4-879d-b4bef54b5d4f {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:04 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.579s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:04 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:49:04 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager._thread_info {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:49:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread count: 28 {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 19:49:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread info: [<_MainThread(MainThread, started 138417491665024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 19:49:04 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d6095227-4d1c-4bf4-879d-b4bef54b5d4f Sep 10 19:49:04 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:05 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c667f69e-9603-4335-9bf4-1b0425f15dd8 tempest-AttachVolumeNegativeTest-2048411806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d6095227-4d1c-4bf4-879d-b4bef54b5d4f" returned: 0 in 0.966s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c667f69e-9603-4335-9bf4-1b0425f15dd8 tempest-AttachVolumeNegativeTest-2048411806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d6095227-4d1c-4bf4-879d-b4bef54b5d4f {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:05 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d6095227-4d1c-4bf4-879d-b4bef54b5d4f Sep 10 19:49:05 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:05 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c667f69e-9603-4335-9bf4-1b0425f15dd8 tempest-AttachVolumeNegativeTest-2048411806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d6095227-4d1c-4bf4-879d-b4bef54b5d4f" returned: 0 in 0.518s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:05 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c667f69e-9603-4335-9bf4-1b0425f15dd8 tempest-AttachVolumeNegativeTest-2048411806 None] Lock "cinder-quobyte-d6095227-4d1c-4bf4-879d-b4bef54b5d4f" released by "delete_volume" :: held 1.582s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:49:06 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-c667f69e-9603-4335-9bf4-1b0425f15dd8 tempest-AttachVolumeNegativeTest-2048411806 None] Created reservations ['7d0be44c-747e-46db-9e43-4ea5dd958e5b', 'a0a92eba-62b1-4330-b3f6-b37ba5a43f47', 'e8873c19-3039-4621-bf10-b56b3650b64b', '423fb88e-e724-4af3-ae15-c678227ed643'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:49:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c667f69e-9603-4335-9bf4-1b0425f15dd8 tempest-AttachVolumeNegativeTest-2048411806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:49:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c667f69e-9603-4335-9bf4-1b0425f15dd8 tempest-AttachVolumeNegativeTest-2048411806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:49:06 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c667f69e-9603-4335-9bf4-1b0425f15dd8 tempest-AttachVolumeNegativeTest-2048411806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:49:06 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c667f69e-9603-4335-9bf4-1b0425f15dd8 tempest-AttachVolumeNegativeTest-2048411806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:49:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c667f69e-9603-4335-9bf4-1b0425f15dd8 tempest-AttachVolumeNegativeTest-2048411806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:49:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c667f69e-9603-4335-9bf4-1b0425f15dd8 tempest-AttachVolumeNegativeTest-2048411806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:06 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:49:06 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:06 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c667f69e-9603-4335-9bf4-1b0425f15dd8 tempest-AttachVolumeNegativeTest-2048411806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.540s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:06 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-c667f69e-9603-4335-9bf4-1b0425f15dd8 tempest-AttachVolumeNegativeTest-2048411806 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:49:06 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-c667f69e-9603-4335-9bf4-1b0425f15dd8 tempest-AttachVolumeNegativeTest-2048411806 None] Deleted volume successfully. Sep 10 19:49:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c667f69e-9603-4335-9bf4-1b0425f15dd8 tempest-AttachVolumeNegativeTest-2048411806 None] Lock "cinder-d6095227-4d1c-4bf4-879d-b4bef54b5d4f-delete_volume" released by "delete_volume" :: held 2.651s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:49:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-95f2ea94-a865-4b6b-9b27-4a3ce5f7fea3 tempest-AttachVolumeNegativeTest-2048411806 None] Acquiring lock "cinder-b0a338d7-7352-4282-9314-7aed2fb02fae-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:49:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-95f2ea94-a865-4b6b-9b27-4a3ce5f7fea3 tempest-AttachVolumeNegativeTest-2048411806 None] Lock "cinder-b0a338d7-7352-4282-9314-7aed2fb02fae-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:49:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-95f2ea94-a865-4b6b-9b27-4a3ce5f7fea3 tempest-AttachVolumeNegativeTest-2048411806 None] Acquiring lock "cinder-quobyte-b0a338d7-7352-4282-9314-7aed2fb02fae" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:49:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-95f2ea94-a865-4b6b-9b27-4a3ce5f7fea3 tempest-AttachVolumeNegativeTest-2048411806 None] Lock "cinder-quobyte-b0a338d7-7352-4282-9314-7aed2fb02fae" acquired by "delete_volume" :: waited 0.025s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:49:06 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce284b8-8e68-4ff3-a4a8-31dc087a5027]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:49:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-95f2ea94-a865-4b6b-9b27-4a3ce5f7fea3 tempest-AttachVolumeNegativeTest-2048411806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b0a338d7-7352-4282-9314-7aed2fb02fae {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:07 devstack sudo[95472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b0a338d7-7352-4282-9314-7aed2fb02fae Sep 10 19:49:07 devstack sudo[95472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:07 devstack sudo[95472]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-95f2ea94-a865-4b6b-9b27-4a3ce5f7fea3 tempest-AttachVolumeNegativeTest-2048411806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b0a338d7-7352-4282-9314-7aed2fb02fae" returned: 0 in 0.703s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-95f2ea94-a865-4b6b-9b27-4a3ce5f7fea3 tempest-AttachVolumeNegativeTest-2048411806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b0a338d7-7352-4282-9314-7aed2fb02fae {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:07 devstack sudo[95491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b0a338d7-7352-4282-9314-7aed2fb02fae Sep 10 19:49:07 devstack sudo[95491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:08 devstack sudo[95491]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-95f2ea94-a865-4b6b-9b27-4a3ce5f7fea3 tempest-AttachVolumeNegativeTest-2048411806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b0a338d7-7352-4282-9314-7aed2fb02fae" returned: 0 in 0.845s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-95f2ea94-a865-4b6b-9b27-4a3ce5f7fea3 tempest-AttachVolumeNegativeTest-2048411806 None] Lock "cinder-quobyte-b0a338d7-7352-4282-9314-7aed2fb02fae" released by "delete_volume" :: held 1.640s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:49:08 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-95f2ea94-a865-4b6b-9b27-4a3ce5f7fea3 tempest-AttachVolumeNegativeTest-2048411806 None] Created reservations ['01c717b3-8b82-4daa-9ec0-1d73994cf82c', 'bb907500-0f8f-462a-ac4c-34141f94a510', 'cb6b3607-6867-409e-a733-15a8959b18d3', '28bb91ec-6eec-42f7-89c3-04b7b8b8bd8e'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:49:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-95f2ea94-a865-4b6b-9b27-4a3ce5f7fea3 tempest-AttachVolumeNegativeTest-2048411806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:49:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-95f2ea94-a865-4b6b-9b27-4a3ce5f7fea3 tempest-AttachVolumeNegativeTest-2048411806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:49:09 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-95f2ea94-a865-4b6b-9b27-4a3ce5f7fea3 tempest-AttachVolumeNegativeTest-2048411806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:49:09 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-95f2ea94-a865-4b6b-9b27-4a3ce5f7fea3 tempest-AttachVolumeNegativeTest-2048411806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:49:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-95f2ea94-a865-4b6b-9b27-4a3ce5f7fea3 tempest-AttachVolumeNegativeTest-2048411806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:49:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-95f2ea94-a865-4b6b-9b27-4a3ce5f7fea3 tempest-AttachVolumeNegativeTest-2048411806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:09 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:49:09 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:09 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-95f2ea94-a865-4b6b-9b27-4a3ce5f7fea3 tempest-AttachVolumeNegativeTest-2048411806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.487s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:09 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-95f2ea94-a865-4b6b-9b27-4a3ce5f7fea3 tempest-AttachVolumeNegativeTest-2048411806 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:49:09 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-95f2ea94-a865-4b6b-9b27-4a3ce5f7fea3 tempest-AttachVolumeNegativeTest-2048411806 None] Deleted volume successfully. Sep 10 19:49:09 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-95f2ea94-a865-4b6b-9b27-4a3ce5f7fea3 tempest-AttachVolumeNegativeTest-2048411806 None] Lock "cinder-b0a338d7-7352-4282-9314-7aed2fb02fae-delete_volume" released by "delete_volume" :: held 2.862s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:49:09 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0f28fead-61a9-4fa2-8f6a-c47ab6227204 tempest-AttachVolumeNegativeTest-2048411806 None] Acquiring lock "cinder-24cb6b95-1e0d-4a89-a5a6-a6e17cbda4e6-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:49:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0f28fead-61a9-4fa2-8f6a-c47ab6227204 tempest-AttachVolumeNegativeTest-2048411806 None] Lock "cinder-24cb6b95-1e0d-4a89-a5a6-a6e17cbda4e6-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:49:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0f28fead-61a9-4fa2-8f6a-c47ab6227204 tempest-AttachVolumeNegativeTest-2048411806 None] Acquiring lock "cinder-quobyte-24cb6b95-1e0d-4a89-a5a6-a6e17cbda4e6" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:49:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0f28fead-61a9-4fa2-8f6a-c47ab6227204 tempest-AttachVolumeNegativeTest-2048411806 None] Lock "cinder-quobyte-24cb6b95-1e0d-4a89-a5a6-a6e17cbda4e6" acquired by "delete_volume" :: waited 0.060s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:49:10 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[035d6a41-c99d-4333-9aab-dc027b1bfe26]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:49:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0f28fead-61a9-4fa2-8f6a-c47ab6227204 tempest-AttachVolumeNegativeTest-2048411806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-24cb6b95-1e0d-4a89-a5a6-a6e17cbda4e6 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:10 devstack sudo[95553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-24cb6b95-1e0d-4a89-a5a6-a6e17cbda4e6 Sep 10 19:49:10 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:11 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0f28fead-61a9-4fa2-8f6a-c47ab6227204 tempest-AttachVolumeNegativeTest-2048411806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-24cb6b95-1e0d-4a89-a5a6-a6e17cbda4e6" returned: 0 in 1.066s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0f28fead-61a9-4fa2-8f6a-c47ab6227204 tempest-AttachVolumeNegativeTest-2048411806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-24cb6b95-1e0d-4a89-a5a6-a6e17cbda4e6 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:11 devstack sudo[95562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-24cb6b95-1e0d-4a89-a5a6-a6e17cbda4e6 Sep 10 19:49:11 devstack sudo[95562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:11 devstack sudo[95562]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0f28fead-61a9-4fa2-8f6a-c47ab6227204 tempest-AttachVolumeNegativeTest-2048411806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-24cb6b95-1e0d-4a89-a5a6-a6e17cbda4e6" returned: 0 in 0.561s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:11 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0f28fead-61a9-4fa2-8f6a-c47ab6227204 tempest-AttachVolumeNegativeTest-2048411806 None] Lock "cinder-quobyte-24cb6b95-1e0d-4a89-a5a6-a6e17cbda4e6" released by "delete_volume" :: held 1.774s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:49:12 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-0f28fead-61a9-4fa2-8f6a-c47ab6227204 tempest-AttachVolumeNegativeTest-2048411806 None] Created reservations ['0c5042f7-6ef0-4482-8356-0d68c6d5a322', '4a1766ce-8d9d-408a-b174-ad1efaf6b630', '4cb2ddeb-7b98-4de9-b9be-33e11e12bcae', '535c0c4d-5d3a-45b0-a202-48107a725b49'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:49:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0f28fead-61a9-4fa2-8f6a-c47ab6227204 tempest-AttachVolumeNegativeTest-2048411806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:49:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0f28fead-61a9-4fa2-8f6a-c47ab6227204 tempest-AttachVolumeNegativeTest-2048411806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:49:12 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0f28fead-61a9-4fa2-8f6a-c47ab6227204 tempest-AttachVolumeNegativeTest-2048411806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:49:12 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0f28fead-61a9-4fa2-8f6a-c47ab6227204 tempest-AttachVolumeNegativeTest-2048411806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:49:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0f28fead-61a9-4fa2-8f6a-c47ab6227204 tempest-AttachVolumeNegativeTest-2048411806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:49:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0f28fead-61a9-4fa2-8f6a-c47ab6227204 tempest-AttachVolumeNegativeTest-2048411806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:12 devstack sudo[95565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:49:12 devstack sudo[95565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:12 devstack sudo[95565]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0f28fead-61a9-4fa2-8f6a-c47ab6227204 tempest-AttachVolumeNegativeTest-2048411806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.474s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:12 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-0f28fead-61a9-4fa2-8f6a-c47ab6227204 tempest-AttachVolumeNegativeTest-2048411806 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:49:12 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-0f28fead-61a9-4fa2-8f6a-c47ab6227204 tempest-AttachVolumeNegativeTest-2048411806 None] Deleted volume successfully. Sep 10 19:49:12 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0f28fead-61a9-4fa2-8f6a-c47ab6227204 tempest-AttachVolumeNegativeTest-2048411806 None] Lock "cinder-24cb6b95-1e0d-4a89-a5a6-a6e17cbda4e6-delete_volume" released by "delete_volume" :: held 2.830s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:49:14 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:49:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] Flow 'volume_create_manager' (e02bb882-e1c7-4886-8f01-903341aab6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:49:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91a5b6f-1916-4076-ab13-ae6fee197eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91a5b6f-1916-4076-ab13-ae6fee197eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1910872684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c954c5f1-195a-455d-95ba-f237c1f45781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee1d684ea55413799e88ad40cce165b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:49:14Z,use_quota=True,user_id='498306ded0324a4e982ef5449608a759',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b749e5fe-dcec-4822-ad9e-d8255ee2eb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b749e5fe-dcec-4822-ad9e-d8255ee2eb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2428aee-a090-400c-a4bc-38e5d72bbd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2428aee-a090-400c-a4bc-38e5d72bbd68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c954c5f1-195a-455d-95ba-f237c1f45781', 'volume_name': 'volume-c954c5f1-195a-455d-95ba-f237c1f45781', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e5fcfa2-f6cd-41f0-a68c-32655199b12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e5fcfa2-f6cd-41f0-a68c-32655199b12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0afbecf7-1e6c-4153-acdc-222295faed5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:14 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] Volume c954c5f1-195a-455d-95ba-f237c1f45781: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c954c5f1-195a-455d-95ba-f237c1f45781', 'volume_size': 1} Sep 10 19:49:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:49:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:49:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1910872684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c954c5f1-195a-455d-95ba-f237c1f45781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee1d684ea55413799e88ad40cce165b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:49:14Z,use_quota=True,user_id='498306ded0324a4e982ef5449608a759',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:49:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] Creating volume c954c5f1-195a-455d-95ba-f237c1f45781 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:49:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:49:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:49:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:49:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:49:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:49:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:49:14 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:49:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:14 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781 1073741824 Sep 10 19:49:14 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:15 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781 1073741824" returned: 0 in 0.831s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:15 devstack sudo[95590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781 Sep 10 19:49:15 devstack sudo[95590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:15 devstack sudo[95590]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781" returned: 0 in 0.425s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:15 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:49:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:49:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0afbecf7-1e6c-4153-acdc-222295faed5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c954c5f1-195a-455d-95ba-f237c1f45781', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53999207-db62-4766-b3e7-b02ccbe3199c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:15 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] Volume volume-c954c5f1-195a-455d-95ba-f237c1f45781 (c954c5f1-195a-455d-95ba-f237c1f45781): created successfully Sep 10 19:49:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53999207-db62-4766-b3e7-b02ccbe3199c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] Flow 'volume_create_manager' (e02bb882-e1c7-4886-8f01-903341aab6bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:49:15 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-878ac794-822a-4a09-a91d-d803a83c531a tempest-TestStampPattern-66311909 None] Created volume successfully. Sep 10 19:49:25 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=16,cinder:INSERT=9,cinder:UPDATE=24,cinder:DELETE=2 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:49:25 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:49:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] Flow 'volume_create_manager' (570c4e33-944b-4893-a567-8c2bd3cebbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:49:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a37f544-e189-4057-815b-2af691fb0985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a37f544-e189-4057-815b-2af691fb0985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1878621733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac60f8f3-865e-430e-b9e6-61c6f3eac91b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eecd711d214a48909aba048632c327ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:49:26Z,use_quota=True,user_id='dcf5c4ac8b6b44d59ee83c78f129527e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f8e4a1-0b1e-4339-adb9-f702a4684998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f8e4a1-0b1e-4339-adb9-f702a4684998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813f88a2-81b4-46d7-b5ad-0bbc6539c3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813f88a2-81b4-46d7-b5ad-0bbc6539c3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac60f8f3-865e-430e-b9e6-61c6f3eac91b', 'volume_name': 'volume-ac60f8f3-865e-430e-b9e6-61c6f3eac91b', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10cfafda-de6d-4daf-95fc-7ca42f2e284c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10cfafda-de6d-4daf-95fc-7ca42f2e284c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (439e5db4-d7f5-493e-8218-0745ea9663ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:25 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] Volume ac60f8f3-865e-430e-b9e6-61c6f3eac91b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac60f8f3-865e-430e-b9e6-61c6f3eac91b', 'volume_size': 1} Sep 10 19:49:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:49:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:49:25 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1878621733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac60f8f3-865e-430e-b9e6-61c6f3eac91b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eecd711d214a48909aba048632c327ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:49:26Z,use_quota=True,user_id='dcf5c4ac8b6b44d59ee83c78f129527e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:49:25 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] Creating volume ac60f8f3-865e-430e-b9e6-61c6f3eac91b {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:49:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:49:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:49:25 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:49:25 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:49:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:49:25 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:49:25 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:49:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac60f8f3-865e-430e-b9e6-61c6f3eac91b 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:26 devstack sudo[95733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac60f8f3-865e-430e-b9e6-61c6f3eac91b 1073741824 Sep 10 19:49:26 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:26 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac60f8f3-865e-430e-b9e6-61c6f3eac91b 1073741824" returned: 0 in 0.628s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac60f8f3-865e-430e-b9e6-61c6f3eac91b {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:26 devstack sudo[95739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac60f8f3-865e-430e-b9e6-61c6f3eac91b Sep 10 19:49:26 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:27 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac60f8f3-865e-430e-b9e6-61c6f3eac91b" returned: 0 in 0.316s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:27 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:49:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:49:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (439e5db4-d7f5-493e-8218-0745ea9663ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac60f8f3-865e-430e-b9e6-61c6f3eac91b', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (630cfc10-4636-4e39-997c-f200a6618c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:27 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] Volume volume-ac60f8f3-865e-430e-b9e6-61c6f3eac91b (ac60f8f3-865e-430e-b9e6-61c6f3eac91b): created successfully Sep 10 19:49:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (630cfc10-4636-4e39-997c-f200a6618c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] Flow 'volume_create_manager' (570c4e33-944b-4893-a567-8c2bd3cebbd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:49:27 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-a6fb3690-ddd4-4541-a287-7cc4430cbb46 req-95b25107-f9f9-49c8-b10e-9fd637413cd8 tempest-VolumesGetTestJSON-648126461 None] Created volume successfully. Sep 10 19:49:28 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-2bfc1ed2-41c6-4441-8538-b3222335fcc6 req-7b595ec5-5ede-49cb-8813-734ffc8aaad3 tempest-VolumesGetTestJSON-648126461 None] Acquiring lock "cinder-ac60f8f3-865e-430e-b9e6-61c6f3eac91b-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:49:28 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-2bfc1ed2-41c6-4441-8538-b3222335fcc6 req-7b595ec5-5ede-49cb-8813-734ffc8aaad3 tempest-VolumesGetTestJSON-648126461 None] Lock "cinder-ac60f8f3-865e-430e-b9e6-61c6f3eac91b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:49:28 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-2bfc1ed2-41c6-4441-8538-b3222335fcc6 req-7b595ec5-5ede-49cb-8813-734ffc8aaad3 tempest-VolumesGetTestJSON-648126461 None] Acquiring lock "cinder-quobyte-ac60f8f3-865e-430e-b9e6-61c6f3eac91b" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:49:28 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-2bfc1ed2-41c6-4441-8538-b3222335fcc6 req-7b595ec5-5ede-49cb-8813-734ffc8aaad3 tempest-VolumesGetTestJSON-648126461 None] Lock "cinder-quobyte-ac60f8f3-865e-430e-b9e6-61c6f3eac91b" acquired by "delete_volume" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:49:28 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6268ec6-1270-438d-be9e-1c987846826c]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:49:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-2bfc1ed2-41c6-4441-8538-b3222335fcc6 req-7b595ec5-5ede-49cb-8813-734ffc8aaad3 tempest-VolumesGetTestJSON-648126461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac60f8f3-865e-430e-b9e6-61c6f3eac91b {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:28 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac60f8f3-865e-430e-b9e6-61c6f3eac91b Sep 10 19:49:28 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:28 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-2bfc1ed2-41c6-4441-8538-b3222335fcc6 req-7b595ec5-5ede-49cb-8813-734ffc8aaad3 tempest-VolumesGetTestJSON-648126461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac60f8f3-865e-430e-b9e6-61c6f3eac91b" returned: 0 in 0.563s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-2bfc1ed2-41c6-4441-8538-b3222335fcc6 req-7b595ec5-5ede-49cb-8813-734ffc8aaad3 tempest-VolumesGetTestJSON-648126461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac60f8f3-865e-430e-b9e6-61c6f3eac91b {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:28 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac60f8f3-865e-430e-b9e6-61c6f3eac91b Sep 10 19:49:28 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] Flow 'volume_create_manager' (261232b7-6785-42c5-b9ab-f5d76c3140a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80cf626e-1012-4cfd-808b-9981d824a862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80cf626e-1012-4cfd-808b-9981d824a862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1236444886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca24366a-ae8c-41b2-8af1-dc045d585f58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11eaed70a274e5598720adb4e49c31f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:49:29Z,use_quota=True,user_id='d2332f5d24e7409584d29951df773f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:29 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c72ab74d-fdf3-47ae-948d-8112e90548ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c72ab74d-fdf3-47ae-948d-8112e90548ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29089480-dcca-4734-b81e-a688a27adecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29089480-dcca-4734-b81e-a688a27adecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca24366a-ae8c-41b2-8af1-dc045d585f58', 'volume_name': 'volume-ca24366a-ae8c-41b2-8af1-dc045d585f58', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb660d8-cf5e-4a73-9f49-f5fdc93d7311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb660d8-cf5e-4a73-9f49-f5fdc93d7311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7564b8a1-ff35-490e-bda5-7d8b08b449e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:29 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] Volume ca24366a-ae8c-41b2-8af1-dc045d585f58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca24366a-ae8c-41b2-8af1-dc045d585f58', 'volume_size': 1} Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1236444886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca24366a-ae8c-41b2-8af1-dc045d585f58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11eaed70a274e5598720adb4e49c31f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:49:29Z,use_quota=True,user_id='d2332f5d24e7409584d29951df773f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] Creating volume ca24366a-ae8c-41b2-8af1-dc045d585f58 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:49:29 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ca24366a-ae8c-41b2-8af1-dc045d585f58 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-2bfc1ed2-41c6-4441-8538-b3222335fcc6 req-7b595ec5-5ede-49cb-8813-734ffc8aaad3 tempest-VolumesGetTestJSON-648126461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac60f8f3-865e-430e-b9e6-61c6f3eac91b" returned: 0 in 0.409s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-2bfc1ed2-41c6-4441-8538-b3222335fcc6 req-7b595ec5-5ede-49cb-8813-734ffc8aaad3 tempest-VolumesGetTestJSON-648126461 None] Lock "cinder-quobyte-ac60f8f3-865e-430e-b9e6-61c6f3eac91b" released by "delete_volume" :: held 1.042s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:49:29 devstack sudo[95760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ca24366a-ae8c-41b2-8af1-dc045d585f58 1073741824 Sep 10 19:49:29 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG cinder.quota [req-2bfc1ed2-41c6-4441-8538-b3222335fcc6 req-7b595ec5-5ede-49cb-8813-734ffc8aaad3 tempest-VolumesGetTestJSON-648126461 None] Created reservations ['8a2cf7b3-a02c-4162-aaa7-ee172005b533', 'd1e3281c-5c15-43a3-b103-85c1ac5bfbc7', '07c38c9b-fc92-42f2-85ca-5d361266deaf', '39ad20ab-55b3-40d2-8b2d-28cd676f64b9'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-2bfc1ed2-41c6-4441-8538-b3222335fcc6 req-7b595ec5-5ede-49cb-8813-734ffc8aaad3 tempest-VolumesGetTestJSON-648126461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-2bfc1ed2-41c6-4441-8538-b3222335fcc6 req-7b595ec5-5ede-49cb-8813-734ffc8aaad3 tempest-VolumesGetTestJSON-648126461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [req-2bfc1ed2-41c6-4441-8538-b3222335fcc6 req-7b595ec5-5ede-49cb-8813-734ffc8aaad3 tempest-VolumesGetTestJSON-648126461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [req-2bfc1ed2-41c6-4441-8538-b3222335fcc6 req-7b595ec5-5ede-49cb-8813-734ffc8aaad3 tempest-VolumesGetTestJSON-648126461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-2bfc1ed2-41c6-4441-8538-b3222335fcc6 req-7b595ec5-5ede-49cb-8813-734ffc8aaad3 tempest-VolumesGetTestJSON-648126461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-2bfc1ed2-41c6-4441-8538-b3222335fcc6 req-7b595ec5-5ede-49cb-8813-734ffc8aaad3 tempest-VolumesGetTestJSON-648126461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:29 devstack sudo[95762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:49:29 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:29 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-2bfc1ed2-41c6-4441-8538-b3222335fcc6 req-7b595ec5-5ede-49cb-8813-734ffc8aaad3 tempest-VolumesGetTestJSON-648126461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.357s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG cinder.manager [req-2bfc1ed2-41c6-4441-8538-b3222335fcc6 req-7b595ec5-5ede-49cb-8813-734ffc8aaad3 tempest-VolumesGetTestJSON-648126461 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:49:29 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:29 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-2bfc1ed2-41c6-4441-8538-b3222335fcc6 req-7b595ec5-5ede-49cb-8813-734ffc8aaad3 tempest-VolumesGetTestJSON-648126461 None] Deleted volume successfully. Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ca24366a-ae8c-41b2-8af1-dc045d585f58 1073741824" returned: 0 in 0.694s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:29 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-2bfc1ed2-41c6-4441-8538-b3222335fcc6 req-7b595ec5-5ede-49cb-8813-734ffc8aaad3 tempest-VolumesGetTestJSON-648126461 None] Lock "cinder-ac60f8f3-865e-430e-b9e6-61c6f3eac91b-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:49:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ca24366a-ae8c-41b2-8af1-dc045d585f58 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:30 devstack sudo[95770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ca24366a-ae8c-41b2-8af1-dc045d585f58 Sep 10 19:49:30 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:30 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ca24366a-ae8c-41b2-8af1-dc045d585f58" returned: 0 in 0.307s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:30 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:49:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:49:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7564b8a1-ff35-490e-bda5-7d8b08b449e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca24366a-ae8c-41b2-8af1-dc045d585f58', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa48a42-01f7-433c-84b5-28e66297deab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:30 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] Volume volume-ca24366a-ae8c-41b2-8af1-dc045d585f58 (ca24366a-ae8c-41b2-8af1-dc045d585f58): created successfully Sep 10 19:49:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa48a42-01f7-433c-84b5-28e66297deab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] Flow 'volume_create_manager' (261232b7-6785-42c5-b9ab-f5d76c3140a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:49:30 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-3fb03841-01af-40ed-8a9b-98aff74dc2e3 tempest-AttachVolumeTestJSON-633113798 None] Created volume successfully. Sep 10 19:49:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-8d5080b1-570e-4eb7-9db1-a5efb861ba7a req-2475701b-c4b1-49cb-964a-804904ecfc5b tempest-AttachVolumeTestJSON-633113798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:49:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-8d5080b1-570e-4eb7-9db1-a5efb861ba7a req-2475701b-c4b1-49cb-964a-804904ecfc5b tempest-AttachVolumeTestJSON-633113798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:49:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-8d5080b1-570e-4eb7-9db1-a5efb861ba7a req-2475701b-c4b1-49cb-964a-804904ecfc5b tempest-AttachVolumeTestJSON-633113798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:49:32 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-8d5080b1-570e-4eb7-9db1-a5efb861ba7a req-2475701b-c4b1-49cb-964a-804904ecfc5b tempest-AttachVolumeTestJSON-633113798 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3', 'name': 'volume-ca24366a-ae8c-41b2-8af1-dc045d585f58', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e8ace8ad-1d55-4149-8d3c-a15449a0f25f', 'enforce_multipath': True} {{(pid=88093) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 19:49:32 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-8d5080b1-570e-4eb7-9db1-a5efb861ba7a req-2475701b-c4b1-49cb-964a-804904ecfc5b tempest-AttachVolumeTestJSON-633113798 None] attachment_update completed successfully. Sep 10 19:49:37 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:49:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] Flow 'volume_create_manager' (4d067d07-cb36-4d28-9299-e62bd2ed1df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:49:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df59a3e7-c4d3-470c-9edf-6a1091ce437c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df59a3e7-c4d3-470c-9edf-6a1091ce437c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1544901194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a55c376-bd3a-4b84-adf2-49b5b60a7096,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1de826b6db0b4819bcb81c028e0f8110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:49:37Z,use_quota=True,user_id='b6f2b02fb14d4428befcaf5d2f3fb4f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc4b8c2-fe62-43a6-9009-22020981fad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc4b8c2-fe62-43a6-9009-22020981fad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e1334b8-b1c0-479f-bfe7-77752fd74978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e1334b8-b1c0-479f-bfe7-77752fd74978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a55c376-bd3a-4b84-adf2-49b5b60a7096', 'volume_name': 'volume-1a55c376-bd3a-4b84-adf2-49b5b60a7096', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a278876-bdea-4d35-9b0f-cb66d34f396e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a278876-bdea-4d35-9b0f-cb66d34f396e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5cd9157-b57e-4d17-be63-3ddeb0f713f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:37 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] Volume 1a55c376-bd3a-4b84-adf2-49b5b60a7096: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a55c376-bd3a-4b84-adf2-49b5b60a7096', 'volume_size': 1} Sep 10 19:49:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:49:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:49:37 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1544901194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a55c376-bd3a-4b84-adf2-49b5b60a7096,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1de826b6db0b4819bcb81c028e0f8110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:49:37Z,use_quota=True,user_id='b6f2b02fb14d4428befcaf5d2f3fb4f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:49:37 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] Creating volume 1a55c376-bd3a-4b84-adf2-49b5b60a7096 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:49:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:49:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:49:37 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:49:37 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:49:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:49:37 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:49:37 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:49:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a55c376-bd3a-4b84-adf2-49b5b60a7096 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:37 devstack sudo[96228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a55c376-bd3a-4b84-adf2-49b5b60a7096 1073741824 Sep 10 19:49:37 devstack sudo[96228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:37 devstack sudo[96228]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a55c376-bd3a-4b84-adf2-49b5b60a7096 1073741824" returned: 0 in 0.526s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a55c376-bd3a-4b84-adf2-49b5b60a7096 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:37 devstack sudo[96242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a55c376-bd3a-4b84-adf2-49b5b60a7096 Sep 10 19:49:37 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-19d5bf4c-7efa-4953-8884-4f05e8703b38 tempest-AttachVolumeShelveTestJSON-1569531410 None] Acquiring lock "cinder-ac741a23-726e-4740-987c-1960ae1fd7ad-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:49:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-19d5bf4c-7efa-4953-8884-4f05e8703b38 tempest-AttachVolumeShelveTestJSON-1569531410 None] Lock "cinder-ac741a23-726e-4740-987c-1960ae1fd7ad-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:49:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-19d5bf4c-7efa-4953-8884-4f05e8703b38 tempest-AttachVolumeShelveTestJSON-1569531410 None] Acquiring lock "cinder-quobyte-ac741a23-726e-4740-987c-1960ae1fd7ad" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:49:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-19d5bf4c-7efa-4953-8884-4f05e8703b38 tempest-AttachVolumeShelveTestJSON-1569531410 None] Lock "cinder-quobyte-ac741a23-726e-4740-987c-1960ae1fd7ad" acquired by "delete_volume" :: waited 0.035s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:49:38 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[e564c0fc-7d0a-48a7-88ab-da8271157c3e]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:49:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-19d5bf4c-7efa-4953-8884-4f05e8703b38 tempest-AttachVolumeShelveTestJSON-1569531410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac741a23-726e-4740-987c-1960ae1fd7ad {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:38 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac741a23-726e-4740-987c-1960ae1fd7ad Sep 10 19:49:38 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:38 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a55c376-bd3a-4b84-adf2-49b5b60a7096" returned: 0 in 0.484s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:38 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:49:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:49:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5cd9157-b57e-4d17-be63-3ddeb0f713f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a55c376-bd3a-4b84-adf2-49b5b60a7096', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c423ba2-2578-4813-9b32-226b8df055d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:38 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] Volume volume-1a55c376-bd3a-4b84-adf2-49b5b60a7096 (1a55c376-bd3a-4b84-adf2-49b5b60a7096): created successfully Sep 10 19:49:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c423ba2-2578-4813-9b32-226b8df055d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] Flow 'volume_create_manager' (4d067d07-cb36-4d28-9299-e62bd2ed1df0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:49:38 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-bd2f3bd9-3d08-410f-ba31-6d300f1e9d72 tempest-VolumesTestJSON-847186070 None] Created volume successfully. Sep 10 19:49:38 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-19d5bf4c-7efa-4953-8884-4f05e8703b38 tempest-AttachVolumeShelveTestJSON-1569531410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac741a23-726e-4740-987c-1960ae1fd7ad" returned: 0 in 0.485s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-19d5bf4c-7efa-4953-8884-4f05e8703b38 tempest-AttachVolumeShelveTestJSON-1569531410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac741a23-726e-4740-987c-1960ae1fd7ad {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:38 devstack sudo[96352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac741a23-726e-4740-987c-1960ae1fd7ad Sep 10 19:49:38 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:38 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-19d5bf4c-7efa-4953-8884-4f05e8703b38 tempest-AttachVolumeShelveTestJSON-1569531410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac741a23-726e-4740-987c-1960ae1fd7ad" returned: 0 in 0.291s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-19d5bf4c-7efa-4953-8884-4f05e8703b38 tempest-AttachVolumeShelveTestJSON-1569531410 None] Lock "cinder-quobyte-ac741a23-726e-4740-987c-1960ae1fd7ad" released by "delete_volume" :: held 0.837s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:49:38 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-19d5bf4c-7efa-4953-8884-4f05e8703b38 tempest-AttachVolumeShelveTestJSON-1569531410 None] Created reservations ['2cc05598-d437-420b-8c1d-108b8825a273', '1a9269fa-85a0-4a7d-b0cf-66948001940e', '3978db69-ed50-4952-977b-235c2ee3f674', '59e8ef60-b41d-4995-bf31-29d1a546518c'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:49:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-19d5bf4c-7efa-4953-8884-4f05e8703b38 tempest-AttachVolumeShelveTestJSON-1569531410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:49:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-19d5bf4c-7efa-4953-8884-4f05e8703b38 tempest-AttachVolumeShelveTestJSON-1569531410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:49:38 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-19d5bf4c-7efa-4953-8884-4f05e8703b38 tempest-AttachVolumeShelveTestJSON-1569531410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:49:38 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-19d5bf4c-7efa-4953-8884-4f05e8703b38 tempest-AttachVolumeShelveTestJSON-1569531410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:49:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-19d5bf4c-7efa-4953-8884-4f05e8703b38 tempest-AttachVolumeShelveTestJSON-1569531410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:49:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-19d5bf4c-7efa-4953-8884-4f05e8703b38 tempest-AttachVolumeShelveTestJSON-1569531410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:39 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:49:39 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:39 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-19d5bf4c-7efa-4953-8884-4f05e8703b38 tempest-AttachVolumeShelveTestJSON-1569531410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.455s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:39 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-19d5bf4c-7efa-4953-8884-4f05e8703b38 tempest-AttachVolumeShelveTestJSON-1569531410 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:49:39 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-19d5bf4c-7efa-4953-8884-4f05e8703b38 tempest-AttachVolumeShelveTestJSON-1569531410 None] Deleted volume successfully. Sep 10 19:49:39 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-19d5bf4c-7efa-4953-8884-4f05e8703b38 tempest-AttachVolumeShelveTestJSON-1569531410 None] Lock "cinder-ac741a23-726e-4740-987c-1960ae1fd7ad-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:49:40 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:49:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] Flow 'volume_create_manager' (22a24788-1d02-497a-a9da-ce3c0613727d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:49:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25660554-da64-4b5e-b6ec-1867361c2cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25660554-da64-4b5e-b6ec-1867361c2cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-271359780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b9ad8b3-f4cc-42fd-a1e2-93aa99810205,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1de826b6db0b4819bcb81c028e0f8110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:49:40Z,use_quota=True,user_id='b6f2b02fb14d4428befcaf5d2f3fb4f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fcbde74-17ef-44cd-8597-9897648bce3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fcbde74-17ef-44cd-8597-9897648bce3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e09de9-3a0a-49e1-8f8c-480f3952796a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e09de9-3a0a-49e1-8f8c-480f3952796a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b9ad8b3-f4cc-42fd-a1e2-93aa99810205', 'volume_name': 'volume-1b9ad8b3-f4cc-42fd-a1e2-93aa99810205', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f92d169f-3191-4502-87ee-29933bcdfbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f92d169f-3191-4502-87ee-29933bcdfbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c2b4e54-a0e3-4ce3-8f4c-0509bbf72333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:40 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] Volume 1b9ad8b3-f4cc-42fd-a1e2-93aa99810205: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b9ad8b3-f4cc-42fd-a1e2-93aa99810205', 'volume_size': 1} Sep 10 19:49:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:49:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:49:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-271359780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b9ad8b3-f4cc-42fd-a1e2-93aa99810205,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1de826b6db0b4819bcb81c028e0f8110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:49:40Z,use_quota=True,user_id='b6f2b02fb14d4428befcaf5d2f3fb4f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:49:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] Creating volume 1b9ad8b3-f4cc-42fd-a1e2-93aa99810205 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:49:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:49:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:49:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:49:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:49:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:49:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:49:40 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:49:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1b9ad8b3-f4cc-42fd-a1e2-93aa99810205 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:40 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1b9ad8b3-f4cc-42fd-a1e2-93aa99810205 1073741824 Sep 10 19:49:40 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:40 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1b9ad8b3-f4cc-42fd-a1e2-93aa99810205 1073741824" returned: 0 in 0.505s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1b9ad8b3-f4cc-42fd-a1e2-93aa99810205 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:40 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1b9ad8b3-f4cc-42fd-a1e2-93aa99810205 Sep 10 19:49:40 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:41 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1b9ad8b3-f4cc-42fd-a1e2-93aa99810205" returned: 0 in 0.441s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:49:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:49:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c2b4e54-a0e3-4ce3-8f4c-0509bbf72333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b9ad8b3-f4cc-42fd-a1e2-93aa99810205', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eac0ac8-ba45-4ef4-8828-cae192350f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:41 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] Volume volume-1b9ad8b3-f4cc-42fd-a1e2-93aa99810205 (1b9ad8b3-f4cc-42fd-a1e2-93aa99810205): created successfully Sep 10 19:49:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eac0ac8-ba45-4ef4-8828-cae192350f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] Flow 'volume_create_manager' (22a24788-1d02-497a-a9da-ce3c0613727d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:49:41 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-d1e98397-6531-4ffe-a9e3-22b20fdf0a8b tempest-VolumesTestJSON-847186070 None] Created volume successfully. Sep 10 19:49:42 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:49:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] Flow 'volume_create_manager' (4201e29d-ed80-4cef-b9f7-ed4fa0f595a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:49:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b20a103-3d40-44e9-beec-8fb52d096e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b20a103-3d40-44e9-beec-8fb52d096e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1041481464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f4541b8-ca1a-4743-8541-cde26ae70ff7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1de826b6db0b4819bcb81c028e0f8110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:49:43Z,use_quota=True,user_id='b6f2b02fb14d4428befcaf5d2f3fb4f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da882e3b-e3bb-4b36-bd79-47a096b7797f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da882e3b-e3bb-4b36-bd79-47a096b7797f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a69d5d97-d9fd-4d17-b4cd-24672d09a692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a69d5d97-d9fd-4d17-b4cd-24672d09a692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f4541b8-ca1a-4743-8541-cde26ae70ff7', 'volume_name': 'volume-8f4541b8-ca1a-4743-8541-cde26ae70ff7', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ca338f-3eaa-4b3c-9336-9fb61bd17430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ca338f-3eaa-4b3c-9336-9fb61bd17430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a417538a-e92c-4c21-a0d9-42fead85a309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:43 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] Volume 8f4541b8-ca1a-4743-8541-cde26ae70ff7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f4541b8-ca1a-4743-8541-cde26ae70ff7', 'volume_size': 1} Sep 10 19:49:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:49:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:49:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1041481464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f4541b8-ca1a-4743-8541-cde26ae70ff7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1de826b6db0b4819bcb81c028e0f8110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:49:43Z,use_quota=True,user_id='b6f2b02fb14d4428befcaf5d2f3fb4f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:49:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] Creating volume 8f4541b8-ca1a-4743-8541-cde26ae70ff7 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:49:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:49:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:49:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:49:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:49:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:49:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:49:43 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:49:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4541b8-ca1a-4743-8541-cde26ae70ff7 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:43 devstack sudo[96763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4541b8-ca1a-4743-8541-cde26ae70ff7 1073741824 Sep 10 19:49:43 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:43 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4541b8-ca1a-4743-8541-cde26ae70ff7 1073741824" returned: 0 in 0.645s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4541b8-ca1a-4743-8541-cde26ae70ff7 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:44 devstack sudo[96769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4541b8-ca1a-4743-8541-cde26ae70ff7 Sep 10 19:49:44 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:44 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4541b8-ca1a-4743-8541-cde26ae70ff7" returned: 0 in 0.428s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:44 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:49:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:49:44 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a417538a-e92c-4c21-a0d9-42fead85a309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f4541b8-ca1a-4743-8541-cde26ae70ff7', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:44 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (250b33ba-89cf-42b4-a3db-b523ed4cfda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:44 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] Volume volume-8f4541b8-ca1a-4743-8541-cde26ae70ff7 (8f4541b8-ca1a-4743-8541-cde26ae70ff7): created successfully Sep 10 19:49:44 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (250b33ba-89cf-42b4-a3db-b523ed4cfda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:44 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] Flow 'volume_create_manager' (4201e29d-ed80-4cef-b9f7-ed4fa0f595a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:49:44 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-d7fa13a6-e544-4eae-98a9-893b9d6687b6 tempest-VolumesTestJSON-847186070 None] Created volume successfully. Sep 10 19:49:46 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ecafa98d-59fa-4995-b376-58faaa06cde0 tempest-VolumesTestJSON-847186070 None] Acquiring lock "cinder-8f4541b8-ca1a-4743-8541-cde26ae70ff7-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:49:46 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ecafa98d-59fa-4995-b376-58faaa06cde0 tempest-VolumesTestJSON-847186070 None] Lock "cinder-8f4541b8-ca1a-4743-8541-cde26ae70ff7-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:49:46 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ecafa98d-59fa-4995-b376-58faaa06cde0 tempest-VolumesTestJSON-847186070 None] Acquiring lock "cinder-quobyte-8f4541b8-ca1a-4743-8541-cde26ae70ff7" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:49:46 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ecafa98d-59fa-4995-b376-58faaa06cde0 tempest-VolumesTestJSON-847186070 None] Lock "cinder-quobyte-8f4541b8-ca1a-4743-8541-cde26ae70ff7" acquired by "delete_volume" :: waited 0.038s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:49:46 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[6391dce9-0c23-4d95-a2e1-31f37f0c5845]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:49:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ecafa98d-59fa-4995-b376-58faaa06cde0 tempest-VolumesTestJSON-847186070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4541b8-ca1a-4743-8541-cde26ae70ff7 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:46 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4541b8-ca1a-4743-8541-cde26ae70ff7 Sep 10 19:49:46 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:47 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ecafa98d-59fa-4995-b376-58faaa06cde0 tempest-VolumesTestJSON-847186070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4541b8-ca1a-4743-8541-cde26ae70ff7" returned: 0 in 0.362s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ecafa98d-59fa-4995-b376-58faaa06cde0 tempest-VolumesTestJSON-847186070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4541b8-ca1a-4743-8541-cde26ae70ff7 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:47 devstack sudo[96799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4541b8-ca1a-4743-8541-cde26ae70ff7 Sep 10 19:49:47 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:47 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ecafa98d-59fa-4995-b376-58faaa06cde0 tempest-VolumesTestJSON-847186070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4541b8-ca1a-4743-8541-cde26ae70ff7" returned: 0 in 0.263s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:47 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ecafa98d-59fa-4995-b376-58faaa06cde0 tempest-VolumesTestJSON-847186070 None] Lock "cinder-quobyte-8f4541b8-ca1a-4743-8541-cde26ae70ff7" released by "delete_volume" :: held 0.687s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:49:47 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-ecafa98d-59fa-4995-b376-58faaa06cde0 tempest-VolumesTestJSON-847186070 None] Created reservations ['86ee2d79-b7f8-459a-b48a-aae839218b5b', '2b3a7bbf-4390-44f2-8a53-76ca146696e0', '7803b6bf-0256-4bff-9cb7-5aea7baea701', '90a129cf-ff63-43d5-b821-78b8e5139e85'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:49:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ecafa98d-59fa-4995-b376-58faaa06cde0 tempest-VolumesTestJSON-847186070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:49:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ecafa98d-59fa-4995-b376-58faaa06cde0 tempest-VolumesTestJSON-847186070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:49:47 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ecafa98d-59fa-4995-b376-58faaa06cde0 tempest-VolumesTestJSON-847186070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:49:47 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ecafa98d-59fa-4995-b376-58faaa06cde0 tempest-VolumesTestJSON-847186070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:49:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ecafa98d-59fa-4995-b376-58faaa06cde0 tempest-VolumesTestJSON-847186070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:49:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ecafa98d-59fa-4995-b376-58faaa06cde0 tempest-VolumesTestJSON-847186070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:47 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:49:47 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:47 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a68c3c12-b253-443e-be1a-2379a6f04ae8 tempest-VolumesTestJSON-847186070 None] Acquiring lock "cinder-1b9ad8b3-f4cc-42fd-a1e2-93aa99810205-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:49:47 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a68c3c12-b253-443e-be1a-2379a6f04ae8 tempest-VolumesTestJSON-847186070 None] Lock "cinder-1b9ad8b3-f4cc-42fd-a1e2-93aa99810205-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:49:48 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a68c3c12-b253-443e-be1a-2379a6f04ae8 tempest-VolumesTestJSON-847186070 None] Acquiring lock "cinder-quobyte-1b9ad8b3-f4cc-42fd-a1e2-93aa99810205" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:49:48 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a68c3c12-b253-443e-be1a-2379a6f04ae8 tempest-VolumesTestJSON-847186070 None] Lock "cinder-quobyte-1b9ad8b3-f4cc-42fd-a1e2-93aa99810205" acquired by "delete_volume" :: waited 0.026s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:49:48 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ecafa98d-59fa-4995-b376-58faaa06cde0 tempest-VolumesTestJSON-847186070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.506s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:48 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-ecafa98d-59fa-4995-b376-58faaa06cde0 tempest-VolumesTestJSON-847186070 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:49:48 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cae34a-4c32-4b63-822a-11c57c3a73e7]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:49:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a68c3c12-b253-443e-be1a-2379a6f04ae8 tempest-VolumesTestJSON-847186070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1b9ad8b3-f4cc-42fd-a1e2-93aa99810205 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:48 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-ecafa98d-59fa-4995-b376-58faaa06cde0 tempest-VolumesTestJSON-847186070 None] Deleted volume successfully. Sep 10 19:49:48 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ecafa98d-59fa-4995-b376-58faaa06cde0 tempest-VolumesTestJSON-847186070 None] Lock "cinder-8f4541b8-ca1a-4743-8541-cde26ae70ff7-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:49:48 devstack sudo[96805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1b9ad8b3-f4cc-42fd-a1e2-93aa99810205 Sep 10 19:49:48 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:48 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a68c3c12-b253-443e-be1a-2379a6f04ae8 tempest-VolumesTestJSON-847186070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1b9ad8b3-f4cc-42fd-a1e2-93aa99810205" returned: 0 in 0.464s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a68c3c12-b253-443e-be1a-2379a6f04ae8 tempest-VolumesTestJSON-847186070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1b9ad8b3-f4cc-42fd-a1e2-93aa99810205 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:48 devstack sudo[96814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1b9ad8b3-f4cc-42fd-a1e2-93aa99810205 Sep 10 19:49:48 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:48 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a68c3c12-b253-443e-be1a-2379a6f04ae8 tempest-VolumesTestJSON-847186070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1b9ad8b3-f4cc-42fd-a1e2-93aa99810205" returned: 0 in 0.342s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:48 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a68c3c12-b253-443e-be1a-2379a6f04ae8 tempest-VolumesTestJSON-847186070 None] Lock "cinder-quobyte-1b9ad8b3-f4cc-42fd-a1e2-93aa99810205" released by "delete_volume" :: held 0.861s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:49:49 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-a68c3c12-b253-443e-be1a-2379a6f04ae8 tempest-VolumesTestJSON-847186070 None] Created reservations ['6b806a65-97e7-40dd-ab8d-ff80f0ecd389', '435760ec-584a-443a-be23-02524b826d87', '1c2ca70e-5d14-436a-a2dc-1748a829c3e6', '78819025-72bc-42a0-9991-2dccc34a7803'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:49:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a68c3c12-b253-443e-be1a-2379a6f04ae8 tempest-VolumesTestJSON-847186070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:49:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a68c3c12-b253-443e-be1a-2379a6f04ae8 tempest-VolumesTestJSON-847186070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:49:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a68c3c12-b253-443e-be1a-2379a6f04ae8 tempest-VolumesTestJSON-847186070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:49:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a68c3c12-b253-443e-be1a-2379a6f04ae8 tempest-VolumesTestJSON-847186070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:49:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a68c3c12-b253-443e-be1a-2379a6f04ae8 tempest-VolumesTestJSON-847186070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:49:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a68c3c12-b253-443e-be1a-2379a6f04ae8 tempest-VolumesTestJSON-847186070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:49 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:49:49 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d4fb7a2f-5b3b-438f-ab48-c14a1c4eb21c tempest-VolumesTestJSON-847186070 None] Acquiring lock "cinder-1a55c376-bd3a-4b84-adf2-49b5b60a7096-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:49:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d4fb7a2f-5b3b-438f-ab48-c14a1c4eb21c tempest-VolumesTestJSON-847186070 None] Lock "cinder-1a55c376-bd3a-4b84-adf2-49b5b60a7096-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:49:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d4fb7a2f-5b3b-438f-ab48-c14a1c4eb21c tempest-VolumesTestJSON-847186070 None] Acquiring lock "cinder-quobyte-1a55c376-bd3a-4b84-adf2-49b5b60a7096" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:49:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d4fb7a2f-5b3b-438f-ab48-c14a1c4eb21c tempest-VolumesTestJSON-847186070 None] Lock "cinder-quobyte-1a55c376-bd3a-4b84-adf2-49b5b60a7096" acquired by "delete_volume" :: waited 0.030s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:49:49 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fda2f2-787f-4cbc-8141-ff9051d8afdc]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:49:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d4fb7a2f-5b3b-438f-ab48-c14a1c4eb21c tempest-VolumesTestJSON-847186070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a55c376-bd3a-4b84-adf2-49b5b60a7096 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:49 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a68c3c12-b253-443e-be1a-2379a6f04ae8 tempest-VolumesTestJSON-847186070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.405s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:49 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-a68c3c12-b253-443e-be1a-2379a6f04ae8 tempest-VolumesTestJSON-847186070 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:49:49 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-a68c3c12-b253-443e-be1a-2379a6f04ae8 tempest-VolumesTestJSON-847186070 None] Deleted volume successfully. Sep 10 19:49:49 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a55c376-bd3a-4b84-adf2-49b5b60a7096 Sep 10 19:49:49 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a68c3c12-b253-443e-be1a-2379a6f04ae8 tempest-VolumesTestJSON-847186070 None] Lock "cinder-1b9ad8b3-f4cc-42fd-a1e2-93aa99810205-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:49:50 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d4fb7a2f-5b3b-438f-ab48-c14a1c4eb21c tempest-VolumesTestJSON-847186070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a55c376-bd3a-4b84-adf2-49b5b60a7096" returned: 0 in 0.613s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d4fb7a2f-5b3b-438f-ab48-c14a1c4eb21c tempest-VolumesTestJSON-847186070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a55c376-bd3a-4b84-adf2-49b5b60a7096 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:50 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a55c376-bd3a-4b84-adf2-49b5b60a7096 Sep 10 19:49:50 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-fb5e294f-a056-4862-87d6-57190a0040e6 req-f5dad121-60d0-4e32-b135-28b7115d5a45 tempest-TestStampPattern-66311909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:49:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-fb5e294f-a056-4862-87d6-57190a0040e6 req-f5dad121-60d0-4e32-b135-28b7115d5a45 tempest-TestStampPattern-66311909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:49:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-fb5e294f-a056-4862-87d6-57190a0040e6 req-f5dad121-60d0-4e32-b135-28b7115d5a45 tempest-TestStampPattern-66311909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:49:50 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d4fb7a2f-5b3b-438f-ab48-c14a1c4eb21c tempest-VolumesTestJSON-847186070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a55c376-bd3a-4b84-adf2-49b5b60a7096" returned: 0 in 0.319s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:50 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d4fb7a2f-5b3b-438f-ab48-c14a1c4eb21c tempest-VolumesTestJSON-847186070 None] Lock "cinder-quobyte-1a55c376-bd3a-4b84-adf2-49b5b60a7096" released by "delete_volume" :: held 1.003s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:49:50 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-fb5e294f-a056-4862-87d6-57190a0040e6 req-f5dad121-60d0-4e32-b135-28b7115d5a45 tempest-TestStampPattern-66311909 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3', 'name': 'volume-c954c5f1-195a-455d-95ba-f237c1f45781', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1ea58f4f-3e40-46bf-9dbd-5e2a74b2e064', 'enforce_multipath': True} {{(pid=88093) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 19:49:50 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-fb5e294f-a056-4862-87d6-57190a0040e6 req-f5dad121-60d0-4e32-b135-28b7115d5a45 tempest-TestStampPattern-66311909 None] attachment_update completed successfully. Sep 10 19:49:50 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-d4fb7a2f-5b3b-438f-ab48-c14a1c4eb21c tempest-VolumesTestJSON-847186070 None] Created reservations ['88460421-c3b1-4aad-9ad4-76d4f8573c03', '9fdc5e40-88ea-4539-bd00-ca4721745ddd', '65a19a61-9f10-4fcd-8774-d34c50668578', '0b4412ad-6e86-44d1-92fd-5dd061f1dd9b'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:49:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d4fb7a2f-5b3b-438f-ab48-c14a1c4eb21c tempest-VolumesTestJSON-847186070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:49:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d4fb7a2f-5b3b-438f-ab48-c14a1c4eb21c tempest-VolumesTestJSON-847186070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:49:50 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d4fb7a2f-5b3b-438f-ab48-c14a1c4eb21c tempest-VolumesTestJSON-847186070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:49:50 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d4fb7a2f-5b3b-438f-ab48-c14a1c4eb21c tempest-VolumesTestJSON-847186070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:49:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d4fb7a2f-5b3b-438f-ab48-c14a1c4eb21c tempest-VolumesTestJSON-847186070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:49:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d4fb7a2f-5b3b-438f-ab48-c14a1c4eb21c tempest-VolumesTestJSON-847186070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:50 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:49:50 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:51 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d4fb7a2f-5b3b-438f-ab48-c14a1c4eb21c tempest-VolumesTestJSON-847186070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.328s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:51 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-d4fb7a2f-5b3b-438f-ab48-c14a1c4eb21c tempest-VolumesTestJSON-847186070 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:49:51 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-d4fb7a2f-5b3b-438f-ab48-c14a1c4eb21c tempest-VolumesTestJSON-847186070 None] Deleted volume successfully. Sep 10 19:49:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d4fb7a2f-5b3b-438f-ab48-c14a1c4eb21c tempest-VolumesTestJSON-847186070 None] Lock "cinder-1a55c376-bd3a-4b84-adf2-49b5b60a7096-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:49:56 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-3755ed91-182d-4bce-af74-f0098bdcf1b6 req-b656951d-e00c-4508-9379-cc67a77dab98 tempest-TestStampPattern-66311909 None] Terminate volume connection completed successfully. Sep 10 19:49:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-3755ed91-182d-4bce-af74-f0098bdcf1b6 req-b656951d-e00c-4508-9379-cc67a77dab98 tempest-TestStampPattern-66311909 None] Deleting attachment 1ea58f4f-3e40-46bf-9dbd-5e2a74b2e064. {{(pid=88093) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 19:49:57 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-320f5b70-daeb-4cbd-898d-591bf8266354 tempest-GroupSnapshotsTest-901873335 None] Group tempest-GroupSnapshotsTest-Group-659621649: creating Sep 10 19:49:57 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-320f5b70-daeb-4cbd-898d-591bf8266354 tempest-GroupSnapshotsTest-901873335 None] Group tempest-GroupSnapshotsTest-Group-659621649: created successfully Sep 10 19:49:57 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-320f5b70-daeb-4cbd-898d-591bf8266354 tempest-GroupSnapshotsTest-901873335 None] Create group completed successfully. Sep 10 19:49:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3d874fd6-2548-49f1-891f-5d72e4ac20b0 tempest-TestStampPattern-66311909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:49:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3d874fd6-2548-49f1-891f-5d72e4ac20b0 tempest-TestStampPattern-66311909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:49:57 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-3d874fd6-2548-49f1-891f-5d72e4ac20b0 tempest-TestStampPattern-66311909 None] Creating offline snapshot 5f2cfd30-0033-4bda-9941-d5df19fbb345 of volume c954c5f1-195a-455d-95ba-f237c1f45781 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 19:49:57 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8fd123-9f77-4399-91af-4a063651e6e4]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:49:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3d874fd6-2548-49f1-891f-5d72e4ac20b0 tempest-TestStampPattern-66311909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:57 devstack sudo[96876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781 Sep 10 19:49:57 devstack sudo[96876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:58 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-654283d3-f6d0-4d29-9c7f-86970c419714 tempest-GroupsV314Test-295808487 None] Group tempest-GroupsV314Test-Group-2145292747: creating Sep 10 19:49:58 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-654283d3-f6d0-4d29-9c7f-86970c419714 tempest-GroupsV314Test-295808487 None] Group tempest-GroupsV314Test-Group-2145292747: created successfully Sep 10 19:49:58 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-654283d3-f6d0-4d29-9c7f-86970c419714 tempest-GroupsV314Test-295808487 None] Create group completed successfully. Sep 10 19:49:58 devstack sudo[96876]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3d874fd6-2548-49f1-891f-5d72e4ac20b0 tempest-TestStampPattern-66311909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781" returned: 0 in 0.416s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3d874fd6-2548-49f1-891f-5d72e4ac20b0 tempest-TestStampPattern-66311909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781.5f2cfd30-0033-4bda-9941-d5df19fbb345 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:58 devstack sudo[96905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781.5f2cfd30-0033-4bda-9941-d5df19fbb345 1G Sep 10 19:49:58 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:58 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3d874fd6-2548-49f1-891f-5d72e4ac20b0 tempest-TestStampPattern-66311909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781.5f2cfd30-0033-4bda-9941-d5df19fbb345 1G" returned: 0 in 0.459s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3d874fd6-2548-49f1-891f-5d72e4ac20b0 tempest-TestStampPattern-66311909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c954c5f1-195a-455d-95ba-f237c1f45781 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781.5f2cfd30-0033-4bda-9941-d5df19fbb345 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:58 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c954c5f1-195a-455d-95ba-f237c1f45781 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781.5f2cfd30-0033-4bda-9941-d5df19fbb345 Sep 10 19:49:58 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:59 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3d874fd6-2548-49f1-891f-5d72e4ac20b0 tempest-TestStampPattern-66311909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c954c5f1-195a-455d-95ba-f237c1f45781 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781.5f2cfd30-0033-4bda-9941-d5df19fbb345" returned: 0 in 0.329s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:59 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-3d874fd6-2548-49f1-891f-5d72e4ac20b0 tempest-TestStampPattern-66311909 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781.5f2cfd30-0033-4bda-9941-d5df19fbb345 is being set with open permissions: ugo+rw Sep 10 19:49:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3d874fd6-2548-49f1-891f-5d72e4ac20b0 tempest-TestStampPattern-66311909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781.5f2cfd30-0033-4bda-9941-d5df19fbb345 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:59 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781.5f2cfd30-0033-4bda-9941-d5df19fbb345 Sep 10 19:49:59 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:59 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:49:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] Flow 'volume_create_manager' (10108707-de6e-4827-bc74-7943933c7b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:49:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f541b37a-a2aa-47f2-a246-dee304ce336f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f541b37a-a2aa-47f2-a246-dee304ce336f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1663717632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=16bb54bb-33a4-4425-97cf-1c58fd8345f4,host='devstack@QuobyteHD#QuobyteHD',id=3fdda367-1a2c-43d7-a050-5d93c33642fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47c1cf4d1734498bd0938a6b8580103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:49:59Z,use_quota=True,user_id='d87a09c27876429f852ac9e937f4358f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3bc109b-92e2-4d44-aec9-ea94829a27e7),volume_type_id=a3bc109b-92e2-4d44-aec9-ea94829a27e7)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f4f0fe8-9b7c-44f9-abbb-9a6b6e7124f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f4f0fe8-9b7c-44f9-abbb-9a6b6e7124f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d353ad32-bb2c-42ec-8333-fa2e23060835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d353ad32-bb2c-42ec-8333-fa2e23060835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fdda367-1a2c-43d7-a050-5d93c33642fb', 'volume_name': 'volume-3fdda367-1a2c-43d7-a050-5d93c33642fb', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f726ef8a-ca40-4a90-962d-bbc3fea467c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f726ef8a-ca40-4a90-962d-bbc3fea467c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e645fb32-2ae7-4859-8962-e123e4cfe3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:59 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] Volume 3fdda367-1a2c-43d7-a050-5d93c33642fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fdda367-1a2c-43d7-a050-5d93c33642fb', 'volume_size': 1} Sep 10 19:49:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:49:59 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3d874fd6-2548-49f1-891f-5d72e4ac20b0 tempest-TestStampPattern-66311909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781.5f2cfd30-0033-4bda-9941-d5df19fbb345" returned: 0 in 0.301s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3d874fd6-2548-49f1-891f-5d72e4ac20b0 tempest-TestStampPattern-66311909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:59 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781.info Sep 10 19:49:59 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:59 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3d874fd6-2548-49f1-891f-5d72e4ac20b0 tempest-TestStampPattern-66311909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781.info" returned: 0 in 0.263s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:49:59 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-3d874fd6-2548-49f1-891f-5d72e4ac20b0 tempest-TestStampPattern-66311909 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781.info is being set with open permissions: ugo+rw Sep 10 19:49:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3d874fd6-2548-49f1-891f-5d72e4ac20b0 tempest-TestStampPattern-66311909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:49:59 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781.info Sep 10 19:49:59 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:49:59 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:49:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] Flow 'volume_create_manager' (0704abbc-8e08-452c-97b0-0dceb9107bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:49:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afec3f06-bdf1-4567-bae5-adbc1eb98a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afec3f06-bdf1-4567-bae5-adbc1eb98a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2046616505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4853277b-7622-451f-bc72-ed7adb7200ba,host='devstack@QuobyteHD#QuobyteHD',id=62d711df-eff6-4816-a505-12f754fbc0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f67a71b933d4fad8dcf2c8c5cd62d51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:50:00Z,use_quota=True,user_id='e2d200e57473415796e2be15db70b33a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de475056-1f59-433c-a93c-1a5992760331),volume_type_id=de475056-1f59-433c-a93c-1a5992760331)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2121f39-26f4-4995-8ddb-3aa6fd7363cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2121f39-26f4-4995-8ddb-3aa6fd7363cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef08875-f16a-4c6d-8edf-8e405129dd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef08875-f16a-4c6d-8edf-8e405129dd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62d711df-eff6-4816-a505-12f754fbc0da', 'volume_name': 'volume-62d711df-eff6-4816-a505-12f754fbc0da', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b2b2a6-c4b6-424e-934f-0e0623324ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b2b2a6-c4b6-424e-934f-0e0623324ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:49:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a76b2434-e608-43c6-9e54-ff9f101b3210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:49:59 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] Volume 62d711df-eff6-4816-a505-12f754fbc0da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62d711df-eff6-4816-a505-12f754fbc0da', 'volume_size': 1} Sep 10 19:49:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:49:59 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Sep 10 19:49:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3d874fd6-2548-49f1-891f-5d72e4ac20b0 tempest-TestStampPattern-66311909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781.info" returned: 0 in 0.328s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3d874fd6-2548-49f1-891f-5d72e4ac20b0 tempest-TestStampPattern-66311909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.188s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:50:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.753s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:50:00 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=16bb54bb-33a4-4425-97cf-1c58fd8345f4,created_at=2026-09-10T17:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1663717632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=16bb54bb-33a4-4425-97cf-1c58fd8345f4,host='devstack@QuobyteHD#QuobyteHD',id=3fdda367-1a2c-43d7-a050-5d93c33642fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47c1cf4d1734498bd0938a6b8580103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:49:59Z,use_quota=True,user_id='d87a09c27876429f852ac9e937f4358f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3bc109b-92e2-4d44-aec9-ea94829a27e7),volume_type_id=a3bc109b-92e2-4d44-aec9-ea94829a27e7)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:50:00 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] Creating volume 3fdda367-1a2c-43d7-a050-5d93c33642fb {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:50:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:50:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:50:00 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:50:00 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:50:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:50:00 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:50:00 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:50:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:00 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb 1073741824 Sep 10 19:50:00 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:00 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-3d874fd6-2548-49f1-891f-5d72e4ac20b0 tempest-TestStampPattern-66311909 None] Create snapshot completed successfully Sep 10 19:50:00 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb 1073741824" returned: 0 in 0.457s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:00 devstack sudo[96933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb Sep 10 19:50:00 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:00 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb" returned: 0 in 0.266s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:00 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:50:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:50:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.826s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:50:00 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4853277b-7622-451f-bc72-ed7adb7200ba,created_at=2026-09-10T17:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2046616505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4853277b-7622-451f-bc72-ed7adb7200ba,host='devstack@QuobyteHD#QuobyteHD',id=62d711df-eff6-4816-a505-12f754fbc0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f67a71b933d4fad8dcf2c8c5cd62d51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:50:00Z,use_quota=True,user_id='e2d200e57473415796e2be15db70b33a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de475056-1f59-433c-a93c-1a5992760331),volume_type_id=de475056-1f59-433c-a93c-1a5992760331)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:50:00 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] Creating volume 62d711df-eff6-4816-a505-12f754fbc0da {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:50:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:50:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:50:00 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:50:00 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:50:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:50:00 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:50:00 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:50:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:00 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da 1073741824 Sep 10 19:50:00 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e645fb32-2ae7-4859-8962-e123e4cfe3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fdda367-1a2c-43d7-a050-5d93c33642fb', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:50:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f2a582-5f7f-46bf-96c1-56de8f933b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:50:00 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] Volume volume-3fdda367-1a2c-43d7-a050-5d93c33642fb (3fdda367-1a2c-43d7-a050-5d93c33642fb): created successfully Sep 10 19:50:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f2a582-5f7f-46bf-96c1-56de8f933b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:50:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] Flow 'volume_create_manager' (10108707-de6e-4827-bc74-7943933c7b68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:50:00 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:UPDATE=99,cinder:SELECT=78,cinder:INSERT=21,cinder:DELETE=6 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:50:00 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-86311fdb-4d86-418c-bd8d-f221c8c7cf65 tempest-GroupSnapshotsTest-901873335 None] Created volume successfully. Sep 10 19:50:01 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da 1073741824" returned: 0 in 0.569s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:01 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da Sep 10 19:50:01 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:01 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da" returned: 0 in 0.331s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:01 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:50:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:50:01 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a76b2434-e608-43c6-9e54-ff9f101b3210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62d711df-eff6-4816-a505-12f754fbc0da', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:50:01 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3370e32-189d-42f3-9c0c-195278c15ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:50:01 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] Volume volume-62d711df-eff6-4816-a505-12f754fbc0da (62d711df-eff6-4816-a505-12f754fbc0da): created successfully Sep 10 19:50:01 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3370e32-189d-42f3-9c0c-195278c15ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:50:01 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] Flow 'volume_create_manager' (0704abbc-8e08-452c-97b0-0dceb9107bf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:50:01 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-19d10ba3-617d-482a-b22f-0430ab79f11c tempest-GroupsV314Test-295808487 None] Created volume successfully. Sep 10 19:50:01 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-59ebd0ca-cf33-43b0-a261-da0d09dab53c tempest-GroupSnapshotsTest-901873335 None] GroupSnapshot c1d7aa8d-7675-427e-84b3-9b00618f9efb: creating. Sep 10 19:50:02 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-59ebd0ca-cf33-43b0-a261-da0d09dab53c tempest-GroupSnapshotsTest-901873335 None] Group snapshot c1d7aa8d-7675-427e-84b3-9b00618f9efb: creating. {{(pid=88093) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 10 19:50:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-59ebd0ca-cf33-43b0-a261-da0d09dab53c tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:50:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-59ebd0ca-cf33-43b0-a261-da0d09dab53c tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:50:02 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-59ebd0ca-cf33-43b0-a261-da0d09dab53c tempest-GroupSnapshotsTest-901873335 None] Creating offline snapshot aa25bc1b-5115-4c7a-a338-0a1c68165a54 of volume 3fdda367-1a2c-43d7-a050-5d93c33642fb {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 19:50:02 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66dc7c2-257a-42e5-93f1-5313acb68587]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:50:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-59ebd0ca-cf33-43b0-a261-da0d09dab53c tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:02 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb Sep 10 19:50:02 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:02 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-59ebd0ca-cf33-43b0-a261-da0d09dab53c tempest-GroupSnapshotsTest-901873335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb" returned: 0 in 0.399s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-59ebd0ca-cf33-43b0-a261-da0d09dab53c tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb.aa25bc1b-5115-4c7a-a338-0a1c68165a54 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:02 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb.aa25bc1b-5115-4c7a-a338-0a1c68165a54 1G Sep 10 19:50:02 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:03 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-59ebd0ca-cf33-43b0-a261-da0d09dab53c tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb.aa25bc1b-5115-4c7a-a338-0a1c68165a54 1G" returned: 0 in 0.639s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-59ebd0ca-cf33-43b0-a261-da0d09dab53c tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fdda367-1a2c-43d7-a050-5d93c33642fb -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb.aa25bc1b-5115-4c7a-a338-0a1c68165a54 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:03 devstack sudo[96962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fdda367-1a2c-43d7-a050-5d93c33642fb -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb.aa25bc1b-5115-4c7a-a338-0a1c68165a54 Sep 10 19:50:03 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:50:03 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-59ebd0ca-cf33-43b0-a261-da0d09dab53c tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fdda367-1a2c-43d7-a050-5d93c33642fb -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb.aa25bc1b-5115-4c7a-a338-0a1c68165a54" returned: 0 in 0.464s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:03 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-59ebd0ca-cf33-43b0-a261-da0d09dab53c tempest-GroupSnapshotsTest-901873335 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb.aa25bc1b-5115-4c7a-a338-0a1c68165a54 is being set with open permissions: ugo+rw: NotImplementedError Sep 10 19:50:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-59ebd0ca-cf33-43b0-a261-da0d09dab53c tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb.aa25bc1b-5115-4c7a-a338-0a1c68165a54 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:03 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb.aa25bc1b-5115-4c7a-a338-0a1c68165a54 Sep 10 19:50:03 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:03 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-59153bd4-ce3d-4f92-aeb2-5fc730025e0e req-4e1d45d3-643a-4a30-bbd9-d5dd3d41f54b tempest-AttachVolumeTestJSON-633113798 None] Terminate volume connection completed successfully. Sep 10 19:50:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-59153bd4-ce3d-4f92-aeb2-5fc730025e0e req-4e1d45d3-643a-4a30-bbd9-d5dd3d41f54b tempest-AttachVolumeTestJSON-633113798 None] Deleting attachment e8ace8ad-1d55-4149-8d3c-a15449a0f25f. {{(pid=88093) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 19:50:03 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:50:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:50:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:50:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:50:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:50:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:50:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:03 devstack sudo[96990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:50:03 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:03 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-59ebd0ca-cf33-43b0-a261-da0d09dab53c tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb.aa25bc1b-5115-4c7a-a338-0a1c68165a54" returned: 0 in 0.346s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-59ebd0ca-cf33-43b0-a261-da0d09dab53c tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:03 devstack sudo[96992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb.info Sep 10 19:50:03 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:04 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.272s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:04 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:50:04 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager._thread_info {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:50:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread count: 28 {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 19:50:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread info: [<_MainThread(MainThread, started 138417491665024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 19:50:04 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-59ebd0ca-cf33-43b0-a261-da0d09dab53c tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb.info" returned: 0 in 0.297s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:04 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-59ebd0ca-cf33-43b0-a261-da0d09dab53c tempest-GroupSnapshotsTest-901873335 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb.info is being set with open permissions: ugo+rw: NotImplementedError Sep 10 19:50:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-59ebd0ca-cf33-43b0-a261-da0d09dab53c tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:04 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb.info Sep 10 19:50:04 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:04 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-59ebd0ca-cf33-43b0-a261-da0d09dab53c tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb.info" returned: 0 in 0.291s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-59ebd0ca-cf33-43b0-a261-da0d09dab53c tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.532s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:50:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.268s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:50:04 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Cloning volume 62d711df-eff6-4816-a505-12f754fbc0da to volume 16866eb7-0aca-4bf8-ac35-b74cf145dc06 Sep 10 19:50:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Creating offline snapshot 2ab50077-0aad-4d34-967c-1b7cc11a4b5c of volume 62d711df-eff6-4816-a505-12f754fbc0da {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 19:50:04 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f2acc2-9360-42de-831c-f0f092b8c44b]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:50:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:04 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-59ebd0ca-cf33-43b0-a261-da0d09dab53c tempest-GroupSnapshotsTest-901873335 None] group_snapshot c1d7aa8d-7675-427e-84b3-9b00618f9efb: created successfully Sep 10 19:50:04 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da Sep 10 19:50:04 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:05 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da" returned: 0 in 0.514s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da.2ab50077-0aad-4d34-967c-1b7cc11a4b5c 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:05 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da.2ab50077-0aad-4d34-967c-1b7cc11a4b5c 1G Sep 10 19:50:05 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:05 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da.2ab50077-0aad-4d34-967c-1b7cc11a4b5c 1G" returned: 0 in 0.567s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62d711df-eff6-4816-a505-12f754fbc0da -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da.2ab50077-0aad-4d34-967c-1b7cc11a4b5c {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:05 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62d711df-eff6-4816-a505-12f754fbc0da -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da.2ab50077-0aad-4d34-967c-1b7cc11a4b5c Sep 10 19:50:05 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:50:06 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62d711df-eff6-4816-a505-12f754fbc0da -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da.2ab50077-0aad-4d34-967c-1b7cc11a4b5c" returned: 0 in 0.425s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:06 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da.2ab50077-0aad-4d34-967c-1b7cc11a4b5c is being set with open permissions: ugo+rw: NotImplementedError Sep 10 19:50:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da.2ab50077-0aad-4d34-967c-1b7cc11a4b5c {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:06 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da.2ab50077-0aad-4d34-967c-1b7cc11a4b5c Sep 10 19:50:06 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:06 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da.2ab50077-0aad-4d34-967c-1b7cc11a4b5c" returned: 0 in 0.324s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:06 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da.info Sep 10 19:50:06 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:06 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da.info" returned: 0 in 0.348s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:06 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da.info is being set with open permissions: ugo+rw: NotImplementedError Sep 10 19:50:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:07 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da.info Sep 10 19:50:07 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:07 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da.info" returned: 0 in 0.326s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Acquiring lock "cinder-quobyte-16866eb7-0aca-4bf8-ac35-b74cf145dc06" by "_copy_volume_from_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:50:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Lock "cinder-quobyte-16866eb7-0aca-4bf8-ac35-b74cf145dc06" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:50:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] snapshot: 2ab50077-0aad-4d34-967c-1b7cc11a4b5c, volume: 16866eb7-0aca-4bf8-ac35-b74cf145dc06, {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 19:50:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:50:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:50:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:50:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:50:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:50:07 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[62183536-fdd5-409b-9f68-866703274cff]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:50:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da.2ab50077-0aad-4d34-967c-1b7cc11a4b5c {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:07 devstack sudo[97044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da.2ab50077-0aad-4d34-967c-1b7cc11a4b5c Sep 10 19:50:07 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:08 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da.2ab50077-0aad-4d34-967c-1b7cc11a4b5c" returned: 0 in 0.744s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62d711df-eff6-4816-a505-12f754fbc0da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:50:08 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d489450-cce5-4ae7-904a-52a8fe7021a4]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:50:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:08 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da Sep 10 19:50:08 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:08 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da" returned: 0 in 0.668s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 19:50:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Creating direct copy from snapshot {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 19:50:08 devstack cinder-volume[88093]: DEBUG cinder.utils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Path /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-16866eb7-0aca-4bf8-ac35-b74cf145dc06 not found in is_blk_device check {{(pid=88093) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 19:50:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-16866eb7-0aca-4bf8-ac35-b74cf145dc06 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:08 devstack sudo[97095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-16866eb7-0aca-4bf8-ac35-b74cf145dc06 Sep 10 19:50:08 devstack sudo[97095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:10 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:50:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Flow 'volume_create_manager' (acdabfd7-3f6a-48bd-a5be-e687564013d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:50:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a745ed60-e168-42cb-bf93-80308b91327e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:50:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a745ed60-e168-42cb-bf93-80308b91327e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-247428887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a7446d-bad4-450d-9879-f4c025d7434c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee1d684ea55413799e88ad40cce165b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5f2cfd30-0033-4bda-9941-d5df19fbb345,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:50:10Z,use_quota=True,user_id='498306ded0324a4e982ef5449608a759',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:50:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d897bfb6-e014-44de-97e4-4cb8f584ba9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:50:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d897bfb6-e014-44de-97e4-4cb8f584ba9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:50:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4273e3e3-b5ee-4ef1-8f52-e700869a5dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:50:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4273e3e3-b5ee-4ef1-8f52-e700869a5dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a4a7446d-bad4-450d-9879-f4c025d7434c', 'volume_name': 'volume-a4a7446d-bad4-450d-9879-f4c025d7434c', 'volume_size': 1, 'snapshot_id': '5f2cfd30-0033-4bda-9941-d5df19fbb345'}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:50:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (772f3379-37b3-455e-a364-d2c289339586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:50:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (772f3379-37b3-455e-a364-d2c289339586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:50:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090c8d65-81c6-48c5-ab3e-402fde26fd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:50:10 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Volume a4a7446d-bad4-450d-9879-f4c025d7434c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a4a7446d-bad4-450d-9879-f4c025d7434c', 'volume_size': 1, 'snapshot_id': '5f2cfd30-0033-4bda-9941-d5df19fbb345'} Sep 10 19:50:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:50:16 devstack sudo[97095]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-16866eb7-0aca-4bf8-ac35-b74cf145dc06" returned: 0 in 7.907s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:16 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Image conversion details: src /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da, size 1024.00 MB, duration 7.91 sec, destination /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-16866eb7-0aca-4bf8-ac35-b74cf145dc06 {{(pid=88093) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 19:50:16 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Converted 1024.00 MB image at 129.50 MB/s Sep 10 19:50:16 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-16866eb7-0aca-4bf8-ac35-b74cf145dc06 is being set with open permissions: ugo+rw: NotImplementedError Sep 10 19:50:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-16866eb7-0aca-4bf8-ac35-b74cf145dc06 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:16 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-16866eb7-0aca-4bf8-ac35-b74cf145dc06 Sep 10 19:50:16 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:17 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-16866eb7-0aca-4bf8-ac35-b74cf145dc06" returned: 0 in 0.322s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:17 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Lock "cinder-quobyte-16866eb7-0aca-4bf8-ac35-b74cf145dc06" released by "_copy_volume_from_snapshot" :: held 9.771s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:50:17 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Acquiring lock "cinder-quobyte-2ab50077-0aad-4d34-967c-1b7cc11a4b5c" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:50:17 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Lock "cinder-quobyte-2ab50077-0aad-4d34-967c-1b7cc11a4b5c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:50:17 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Deleting offline snapshot 2ab50077-0aad-4d34-967c-1b7cc11a4b5c of volume 62d711df-eff6-4816-a505-12f754fbc0da {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 19:50:17 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] snapshot_file for this snap is: volume-62d711df-eff6-4816-a505-12f754fbc0da.2ab50077-0aad-4d34-967c-1b7cc11a4b5c {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 19:50:17 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4558aa-c05f-4aeb-80c1-b50143ea1dff]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:50:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da.2ab50077-0aad-4d34-967c-1b7cc11a4b5c {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:17 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da.2ab50077-0aad-4d34-967c-1b7cc11a4b5c Sep 10 19:50:17 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:17 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da.2ab50077-0aad-4d34-967c-1b7cc11a4b5c" returned: 0 in 0.520s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:17 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62d711df-eff6-4816-a505-12f754fbc0da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:50:17 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[6650cde5-0843-4361-8355-7fdd769e89e7]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:50:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:18 devstack sudo[97186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da Sep 10 19:50:18 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:18 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da" returned: 0 in 1.004s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da.2ab50077-0aad-4d34-967c-1b7cc11a4b5c {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:18 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da.2ab50077-0aad-4d34-967c-1b7cc11a4b5c Sep 10 19:50:18 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:19 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da.2ab50077-0aad-4d34-967c-1b7cc11a4b5c" returned: 0 in 0.668s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da.2ab50077-0aad-4d34-967c-1b7cc11a4b5c {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:19 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da.2ab50077-0aad-4d34-967c-1b7cc11a4b5c Sep 10 19:50:19 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:19 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da.2ab50077-0aad-4d34-967c-1b7cc11a4b5c" returned: 0 in 0.422s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:19 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Lock "cinder-quobyte-2ab50077-0aad-4d34-967c-1b7cc11a4b5c" released by "_delete_snapshot" :: held 2.766s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:50:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.377s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:50:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 13.938s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:50:20 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "cinder-quobyte-aa25bc1b-5115-4c7a-a338-0a1c68165a54-a3ed159e-16f5-49ea-a2a7-50c79bae6f05" by "_create_volume_from_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:50:20 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] Lock "cinder-quobyte-aa25bc1b-5115-4c7a-a338-0a1c68165a54-a3ed159e-16f5-49ea-a2a7-50c79bae6f05" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:50:20 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] Creating volume a3ed159e-16f5-49ea-a2a7-50c79bae6f05 from snapshot aa25bc1b-5115-4c7a-a338-0a1c68165a54 {{(pid=88093) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 10 19:50:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:50:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:50:20 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:50:20 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:50:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:50:20 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:50:20 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "cinder-quobyte-a3ed159e-16f5-49ea-a2a7-50c79bae6f05" by "_copy_volume_from_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:50:20 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] Lock "cinder-quobyte-a3ed159e-16f5-49ea-a2a7-50c79bae6f05" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:50:20 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] snapshot: aa25bc1b-5115-4c7a-a338-0a1c68165a54, volume: a3ed159e-16f5-49ea-a2a7-50c79bae6f05, {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 19:50:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:50:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:50:20 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:50:20 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:50:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:50:20 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[64534f7d-7547-43a5-b88b-2f15bff9ad72]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:50:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb.aa25bc1b-5115-4c7a-a338-0a1c68165a54 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:20 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-edfd6bfe-e2f7-42c8-a319-814b06abe531 tempest-GroupsV314Test-295808487 None] Create group from source-group-4853277b-7622-451f-bc72-ed7adb7200ba completed successfully. Sep 10 19:50:20 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb.aa25bc1b-5115-4c7a-a338-0a1c68165a54 Sep 10 19:50:20 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:20 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb.aa25bc1b-5115-4c7a-a338-0a1c68165a54" returned: 0 in 0.624s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:20 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fdda367-1a2c-43d7-a050-5d93c33642fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:50:20 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd702c6-1883-41b1-a9db-742ecd1775ec]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:50:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:21 devstack sudo[97222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb Sep 10 19:50:21 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:21 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cae69c42-a131-43fc-87fc-d1bfb968a68f tempest-GroupsV314Test-295808487 None] Acquiring lock "cinder-quobyte-16866eb7-0aca-4bf8-ac35-b74cf145dc06" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:50:21 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cae69c42-a131-43fc-87fc-d1bfb968a68f tempest-GroupsV314Test-295808487 None] Lock "cinder-quobyte-16866eb7-0aca-4bf8-ac35-b74cf145dc06" acquired by "delete_volume" :: waited 0.037s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:50:21 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bee00a-d0c0-40d5-8745-ec7ecfce2f0b]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:50:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cae69c42-a131-43fc-87fc-d1bfb968a68f tempest-GroupsV314Test-295808487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-16866eb7-0aca-4bf8-ac35-b74cf145dc06 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:21 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb" returned: 0 in 0.731s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:21 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 19:50:21 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] Creating direct copy from snapshot {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 19:50:21 devstack cinder-volume[88093]: DEBUG cinder.utils [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] Path /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a3ed159e-16f5-49ea-a2a7-50c79bae6f05 not found in is_blk_device check {{(pid=88093) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 19:50:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a3ed159e-16f5-49ea-a2a7-50c79bae6f05 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:21 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-16866eb7-0aca-4bf8-ac35-b74cf145dc06 Sep 10 19:50:21 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:21 devstack sudo[97241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a3ed159e-16f5-49ea-a2a7-50c79bae6f05 Sep 10 19:50:21 devstack sudo[97241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:21 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cae69c42-a131-43fc-87fc-d1bfb968a68f tempest-GroupsV314Test-295808487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-16866eb7-0aca-4bf8-ac35-b74cf145dc06" returned: 0 in 0.590s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cae69c42-a131-43fc-87fc-d1bfb968a68f tempest-GroupsV314Test-295808487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-16866eb7-0aca-4bf8-ac35-b74cf145dc06 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:22 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-16866eb7-0aca-4bf8-ac35-b74cf145dc06 Sep 10 19:50:22 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:22 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cae69c42-a131-43fc-87fc-d1bfb968a68f tempest-GroupsV314Test-295808487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-16866eb7-0aca-4bf8-ac35-b74cf145dc06" returned: 0 in 1.000s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:23 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cae69c42-a131-43fc-87fc-d1bfb968a68f tempest-GroupsV314Test-295808487 None] Lock "cinder-quobyte-16866eb7-0aca-4bf8-ac35-b74cf145dc06" released by "delete_volume" :: held 1.712s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:50:23 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-cae69c42-a131-43fc-87fc-d1bfb968a68f tempest-GroupsV314Test-295808487 None] Created reservations ['60b3c624-da5d-432d-bccd-a2fabe3164be'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:50:23 devstack cinder-volume[88093]: WARNING cinder.quota [None req-cae69c42-a131-43fc-87fc-d1bfb968a68f tempest-GroupsV314Test-295808487 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-677745463 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-677745463, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:50:23 devstack cinder-volume[88093]: WARNING cinder.quota [None req-cae69c42-a131-43fc-87fc-d1bfb968a68f tempest-GroupsV314Test-295808487 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-677745463 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-677745463, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:50:23 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-cae69c42-a131-43fc-87fc-d1bfb968a68f tempest-GroupsV314Test-295808487 None] Created reservations ['040116b9-d2cf-4795-a0ae-a6411202913e', '503dc38e-2d1b-4d90-af94-0de555383209', '6ca8e7d5-ec36-4400-af0a-6605d5ea3665', '29905364-1b89-45eb-9f80-749a0ba68c78'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:50:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cae69c42-a131-43fc-87fc-d1bfb968a68f tempest-GroupsV314Test-295808487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:50:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cae69c42-a131-43fc-87fc-d1bfb968a68f tempest-GroupsV314Test-295808487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:50:24 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-cae69c42-a131-43fc-87fc-d1bfb968a68f tempest-GroupsV314Test-295808487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:50:24 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-cae69c42-a131-43fc-87fc-d1bfb968a68f tempest-GroupsV314Test-295808487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:50:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cae69c42-a131-43fc-87fc-d1bfb968a68f tempest-GroupsV314Test-295808487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:50:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cae69c42-a131-43fc-87fc-d1bfb968a68f tempest-GroupsV314Test-295808487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:24 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:50:24 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:25 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cae69c42-a131-43fc-87fc-d1bfb968a68f tempest-GroupsV314Test-295808487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 1.103s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:25 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-cae69c42-a131-43fc-87fc-d1bfb968a68f tempest-GroupsV314Test-295808487 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:50:25 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-cae69c42-a131-43fc-87fc-d1bfb968a68f tempest-GroupsV314Test-295808487 None] Delete group completed successfully. Sep 10 19:50:25 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b1ced4ee-812a-4361-8056-665975bd02b8 tempest-GroupsV314Test-295808487 None] Acquiring lock "cinder-quobyte-62d711df-eff6-4816-a505-12f754fbc0da" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:50:25 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b1ced4ee-812a-4361-8056-665975bd02b8 tempest-GroupsV314Test-295808487 None] Lock "cinder-quobyte-62d711df-eff6-4816-a505-12f754fbc0da" acquired by "delete_volume" :: waited 0.081s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:50:25 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[8613ae83-c80b-4cef-9414-eb6514b768eb]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:50:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b1ced4ee-812a-4361-8056-665975bd02b8 tempest-GroupsV314Test-295808487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:26 devstack sudo[97314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da Sep 10 19:50:26 devstack sudo[97314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:27 devstack sudo[97314]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b1ced4ee-812a-4361-8056-665975bd02b8 tempest-GroupsV314Test-295808487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da" returned: 0 in 1.164s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b1ced4ee-812a-4361-8056-665975bd02b8 tempest-GroupsV314Test-295808487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:27 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da Sep 10 19:50:27 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:28 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b1ced4ee-812a-4361-8056-665975bd02b8 tempest-GroupsV314Test-295808487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-62d711df-eff6-4816-a505-12f754fbc0da" returned: 0 in 1.158s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:28 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b1ced4ee-812a-4361-8056-665975bd02b8 tempest-GroupsV314Test-295808487 None] Lock "cinder-quobyte-62d711df-eff6-4816-a505-12f754fbc0da" released by "delete_volume" :: held 2.669s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:50:28 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:UPDATE=80,cinder:DELETE=8,cinder:SELECT=84,cinder:INSERT=15 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:50:28 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-b1ced4ee-812a-4361-8056-665975bd02b8 tempest-GroupsV314Test-295808487 None] Created reservations ['68db272d-2885-4211-9721-d84fb59427d8'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:50:29 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-b1ced4ee-812a-4361-8056-665975bd02b8 tempest-GroupsV314Test-295808487 None] Created reservations ['814f56c0-7d77-4631-831d-13dbf6057c96', 'ebf2775c-f5a8-4e3d-9afd-1b26748e5b61', 'e7426cdb-ba6d-47f6-93d2-e0825a7e5958', '2c9707b8-5b58-4c25-bd72-a12a8be19e2a'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:50:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b1ced4ee-812a-4361-8056-665975bd02b8 tempest-GroupsV314Test-295808487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:50:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b1ced4ee-812a-4361-8056-665975bd02b8 tempest-GroupsV314Test-295808487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:50:29 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b1ced4ee-812a-4361-8056-665975bd02b8 tempest-GroupsV314Test-295808487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:50:29 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b1ced4ee-812a-4361-8056-665975bd02b8 tempest-GroupsV314Test-295808487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:50:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b1ced4ee-812a-4361-8056-665975bd02b8 tempest-GroupsV314Test-295808487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:50:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b1ced4ee-812a-4361-8056-665975bd02b8 tempest-GroupsV314Test-295808487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:29 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:50:29 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:30 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b1ced4ee-812a-4361-8056-665975bd02b8 tempest-GroupsV314Test-295808487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.593s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:30 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-b1ced4ee-812a-4361-8056-665975bd02b8 tempest-GroupsV314Test-295808487 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:50:30 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-b1ced4ee-812a-4361-8056-665975bd02b8 tempest-GroupsV314Test-295808487 None] Delete group completed successfully. Sep 10 19:50:30 devstack sudo[97241]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a3ed159e-16f5-49ea-a2a7-50c79bae6f05" returned: 0 in 9.221s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:30 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] Image conversion details: src /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb, size 1024.00 MB, duration 9.22 sec, destination /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a3ed159e-16f5-49ea-a2a7-50c79bae6f05 {{(pid=88093) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 19:50:30 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] Converted 1024.00 MB image at 111.04 MB/s Sep 10 19:50:30 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a3ed159e-16f5-49ea-a2a7-50c79bae6f05 is being set with open permissions: ugo+rw: NotImplementedError Sep 10 19:50:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a3ed159e-16f5-49ea-a2a7-50c79bae6f05 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:30 devstack sudo[97363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a3ed159e-16f5-49ea-a2a7-50c79bae6f05 Sep 10 19:50:30 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:31 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a3ed159e-16f5-49ea-a2a7-50c79bae6f05" returned: 0 in 0.320s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:31 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] Lock "cinder-quobyte-a3ed159e-16f5-49ea-a2a7-50c79bae6f05" released by "_copy_volume_from_snapshot" :: held 11.046s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:50:31 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] Lock "cinder-quobyte-aa25bc1b-5115-4c7a-a338-0a1c68165a54-a3ed159e-16f5-49ea-a2a7-50c79bae6f05" released by "_create_volume_from_snapshot" :: held 11.174s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:50:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.212s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:50:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 20.513s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:50:31 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Acquiring lock "cinder-quobyte-5f2cfd30-0033-4bda-9941-d5df19fbb345-a4a7446d-bad4-450d-9879-f4c025d7434c" by "_create_volume_from_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:50:31 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Lock "cinder-quobyte-5f2cfd30-0033-4bda-9941-d5df19fbb345-a4a7446d-bad4-450d-9879-f4c025d7434c" acquired by "_create_volume_from_snapshot" :: waited 0.056s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:50:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Creating volume a4a7446d-bad4-450d-9879-f4c025d7434c from snapshot 5f2cfd30-0033-4bda-9941-d5df19fbb345 {{(pid=88093) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 10 19:50:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:50:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:50:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:50:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:50:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:50:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:50:31 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Acquiring lock "cinder-quobyte-a4a7446d-bad4-450d-9879-f4c025d7434c" by "_copy_volume_from_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:50:31 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Lock "cinder-quobyte-a4a7446d-bad4-450d-9879-f4c025d7434c" acquired by "_copy_volume_from_snapshot" :: waited 0.066s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:50:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] snapshot: 5f2cfd30-0033-4bda-9941-d5df19fbb345, volume: a4a7446d-bad4-450d-9879-f4c025d7434c, {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 19:50:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:50:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:50:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:50:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:50:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:50:31 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a8168e-5e49-4ec2-a1f2-f7eb7f55c16b]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:50:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781.5f2cfd30-0033-4bda-9941-d5df19fbb345 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:31 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-30df401b-1962-43ea-bd4a-3ba80bb758e9 tempest-GroupSnapshotsTest-901873335 None] Create group from source-snapshot-c1d7aa8d-7675-427e-84b3-9b00618f9efb completed successfully. Sep 10 19:50:31 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781.5f2cfd30-0033-4bda-9941-d5df19fbb345 Sep 10 19:50:31 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:32 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781.5f2cfd30-0033-4bda-9941-d5df19fbb345" returned: 0 in 0.738s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:32 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c954c5f1-195a-455d-95ba-f237c1f45781(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:50:32 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e719e06-61d4-4db6-8edd-6456817001fa]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:50:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:32 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781 Sep 10 19:50:32 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:32 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781" returned: 0 in 0.709s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:33 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781 {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 19:50:33 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Creating direct copy from snapshot {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 19:50:33 devstack cinder-volume[88093]: DEBUG cinder.utils [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Path /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a4a7446d-bad4-450d-9879-f4c025d7434c not found in is_blk_device check {{(pid=88093) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 19:50:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a4a7446d-bad4-450d-9879-f4c025d7434c {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:33 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a4a7446d-bad4-450d-9879-f4c025d7434c Sep 10 19:50:33 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-efe48580-68a1-4f65-a51b-af98c1967f6c tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "cinder-quobyte-a3ed159e-16f5-49ea-a2a7-50c79bae6f05" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:50:33 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:33 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-efe48580-68a1-4f65-a51b-af98c1967f6c tempest-GroupSnapshotsTest-901873335 None] Lock "cinder-quobyte-a3ed159e-16f5-49ea-a2a7-50c79bae6f05" acquired by "delete_volume" :: waited 0.024s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:50:33 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[8daf4515-0dc8-4015-85c2-a1d05b117d8f]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:50:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-efe48580-68a1-4f65-a51b-af98c1967f6c tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a3ed159e-16f5-49ea-a2a7-50c79bae6f05 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:33 devstack sudo[97379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a3ed159e-16f5-49ea-a2a7-50c79bae6f05 Sep 10 19:50:33 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:33 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-efe48580-68a1-4f65-a51b-af98c1967f6c tempest-GroupSnapshotsTest-901873335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a3ed159e-16f5-49ea-a2a7-50c79bae6f05" returned: 0 in 0.716s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-efe48580-68a1-4f65-a51b-af98c1967f6c tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a3ed159e-16f5-49ea-a2a7-50c79bae6f05 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:33 devstack sudo[97392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a3ed159e-16f5-49ea-a2a7-50c79bae6f05 Sep 10 19:50:33 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:34 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-efe48580-68a1-4f65-a51b-af98c1967f6c tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a3ed159e-16f5-49ea-a2a7-50c79bae6f05" returned: 0 in 0.990s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:34 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-efe48580-68a1-4f65-a51b-af98c1967f6c tempest-GroupSnapshotsTest-901873335 None] Lock "cinder-quobyte-a3ed159e-16f5-49ea-a2a7-50c79bae6f05" released by "delete_volume" :: held 1.827s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:50:35 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-efe48580-68a1-4f65-a51b-af98c1967f6c tempest-GroupSnapshotsTest-901873335 None] Created reservations ['63860b23-827e-460f-b1e1-18e2719a9178'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:50:35 devstack cinder-volume[88093]: WARNING cinder.quota [None req-efe48580-68a1-4f65-a51b-af98c1967f6c tempest-GroupSnapshotsTest-901873335 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1565342684 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1565342684, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:50:35 devstack cinder-volume[88093]: WARNING cinder.quota [None req-efe48580-68a1-4f65-a51b-af98c1967f6c tempest-GroupSnapshotsTest-901873335 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1565342684 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1565342684, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:50:35 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-efe48580-68a1-4f65-a51b-af98c1967f6c tempest-GroupSnapshotsTest-901873335 None] Created reservations ['3a23c690-41a9-45bd-89ab-1dfc8356365f', 'b1f2f346-de62-41e3-9300-adba10d4506c', 'c88c7a6e-e480-4944-81be-a6b14066549c', '99e76cd1-18af-4fa0-a3ee-f15fec8ed307'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:50:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-efe48580-68a1-4f65-a51b-af98c1967f6c tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:50:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-efe48580-68a1-4f65-a51b-af98c1967f6c tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:50:35 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-efe48580-68a1-4f65-a51b-af98c1967f6c tempest-GroupSnapshotsTest-901873335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:50:35 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-efe48580-68a1-4f65-a51b-af98c1967f6c tempest-GroupSnapshotsTest-901873335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:50:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-efe48580-68a1-4f65-a51b-af98c1967f6c tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:50:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-efe48580-68a1-4f65-a51b-af98c1967f6c tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:35 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:50:35 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:36 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-02554f07-e38d-4118-837a-ccb5e52f1a63 tempest-GroupSnapshotsTest-901873335 None] group_snapshot c1d7aa8d-7675-427e-84b3-9b00618f9efb: deleting Sep 10 19:50:36 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-02554f07-e38d-4118-837a-ccb5e52f1a63 tempest-GroupSnapshotsTest-901873335 None] group_snapshot c1d7aa8d-7675-427e-84b3-9b00618f9efb: deleting {{(pid=88093) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 10 19:50:36 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-02554f07-e38d-4118-837a-ccb5e52f1a63 tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "cinder-quobyte-3fdda367-1a2c-43d7-a050-5d93c33642fb" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:50:36 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:36 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-02554f07-e38d-4118-837a-ccb5e52f1a63 tempest-GroupSnapshotsTest-901873335 None] Lock "cinder-quobyte-3fdda367-1a2c-43d7-a050-5d93c33642fb" acquired by "delete_snapshot" :: waited 0.061s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:50:36 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-02554f07-e38d-4118-837a-ccb5e52f1a63 tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "cinder-quobyte-aa25bc1b-5115-4c7a-a338-0a1c68165a54" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:50:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-efe48580-68a1-4f65-a51b-af98c1967f6c tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.994s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:36 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-efe48580-68a1-4f65-a51b-af98c1967f6c tempest-GroupSnapshotsTest-901873335 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:50:36 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-efe48580-68a1-4f65-a51b-af98c1967f6c tempest-GroupSnapshotsTest-901873335 None] Delete group completed successfully. Sep 10 19:50:36 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-02554f07-e38d-4118-837a-ccb5e52f1a63 tempest-GroupSnapshotsTest-901873335 None] Lock "cinder-quobyte-aa25bc1b-5115-4c7a-a338-0a1c68165a54" acquired by "_delete_snapshot" :: waited 0.079s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:50:36 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-02554f07-e38d-4118-837a-ccb5e52f1a63 tempest-GroupSnapshotsTest-901873335 None] Deleting offline snapshot aa25bc1b-5115-4c7a-a338-0a1c68165a54 of volume 3fdda367-1a2c-43d7-a050-5d93c33642fb {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 19:50:37 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-02554f07-e38d-4118-837a-ccb5e52f1a63 tempest-GroupSnapshotsTest-901873335 None] snapshot_file for this snap is: volume-3fdda367-1a2c-43d7-a050-5d93c33642fb.aa25bc1b-5115-4c7a-a338-0a1c68165a54 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 19:50:37 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de9d75c-6984-478c-8207-765196f47268]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:50:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-02554f07-e38d-4118-837a-ccb5e52f1a63 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb.aa25bc1b-5115-4c7a-a338-0a1c68165a54 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:37 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb.aa25bc1b-5115-4c7a-a338-0a1c68165a54 Sep 10 19:50:37 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:37 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-02554f07-e38d-4118-837a-ccb5e52f1a63 tempest-GroupSnapshotsTest-901873335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb.aa25bc1b-5115-4c7a-a338-0a1c68165a54" returned: 0 in 0.941s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:38 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-02554f07-e38d-4118-837a-ccb5e52f1a63 tempest-GroupSnapshotsTest-901873335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fdda367-1a2c-43d7-a050-5d93c33642fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:50:38 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[b809d51b-f04d-4db9-9dd6-ad9d01b78d1a]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:50:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-02554f07-e38d-4118-837a-ccb5e52f1a63 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:38 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb Sep 10 19:50:38 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:39 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-02554f07-e38d-4118-837a-ccb5e52f1a63 tempest-GroupSnapshotsTest-901873335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb" returned: 0 in 1.725s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-02554f07-e38d-4118-837a-ccb5e52f1a63 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb.aa25bc1b-5115-4c7a-a338-0a1c68165a54 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:39 devstack sudo[97450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb.aa25bc1b-5115-4c7a-a338-0a1c68165a54 Sep 10 19:50:39 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:40 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-02554f07-e38d-4118-837a-ccb5e52f1a63 tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb.aa25bc1b-5115-4c7a-a338-0a1c68165a54" returned: 0 in 0.994s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-02554f07-e38d-4118-837a-ccb5e52f1a63 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb.aa25bc1b-5115-4c7a-a338-0a1c68165a54 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:40 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb.aa25bc1b-5115-4c7a-a338-0a1c68165a54 Sep 10 19:50:40 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:41 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-02554f07-e38d-4118-837a-ccb5e52f1a63 tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb.aa25bc1b-5115-4c7a-a338-0a1c68165a54" returned: 0 in 0.732s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:41 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-02554f07-e38d-4118-837a-ccb5e52f1a63 tempest-GroupSnapshotsTest-901873335 None] Lock "cinder-quobyte-aa25bc1b-5115-4c7a-a338-0a1c68165a54" released by "_delete_snapshot" :: held 4.744s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:50:41 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-02554f07-e38d-4118-837a-ccb5e52f1a63 tempest-GroupSnapshotsTest-901873335 None] Lock "cinder-quobyte-3fdda367-1a2c-43d7-a050-5d93c33642fb" released by "delete_snapshot" :: held 4.840s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:50:41 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a4a7446d-bad4-450d-9879-f4c025d7434c" returned: 0 in 8.738s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:41 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Image conversion details: src /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781, size 1024.00 MB, duration 8.74 sec, destination /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a4a7446d-bad4-450d-9879-f4c025d7434c {{(pid=88093) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 19:50:41 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Converted 1024.00 MB image at 117.15 MB/s Sep 10 19:50:41 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a4a7446d-bad4-450d-9879-f4c025d7434c is being set with open permissions: ugo+rw Sep 10 19:50:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a4a7446d-bad4-450d-9879-f4c025d7434c {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:41 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a4a7446d-bad4-450d-9879-f4c025d7434c Sep 10 19:50:41 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:41 devstack cinder-volume[88093]: WARNING cinder.quota [None req-02554f07-e38d-4118-837a-ccb5e52f1a63 tempest-GroupSnapshotsTest-901873335 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1565342684 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1565342684, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:50:41 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-02554f07-e38d-4118-837a-ccb5e52f1a63 tempest-GroupSnapshotsTest-901873335 None] Created reservations ['a9013366-ab2b-48a2-af9a-dc894b813fc6', '20ddbb72-332b-4b2f-a6a4-9429262b51d9', '3ce9f7de-bd76-49da-b830-7a092be94001', 'eec9dbe7-daa2-4a4e-86a6-ff723fc8971e'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:50:42 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-02554f07-e38d-4118-837a-ccb5e52f1a63 tempest-GroupSnapshotsTest-901873335 None] group_snapshot c1d7aa8d-7675-427e-84b3-9b00618f9efb: deleted successfully Sep 10 19:50:42 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a4a7446d-bad4-450d-9879-f4c025d7434c" returned: 0 in 0.410s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:42 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Lock "cinder-quobyte-a4a7446d-bad4-450d-9879-f4c025d7434c" released by "_copy_volume_from_snapshot" :: held 10.803s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:50:42 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Lock "cinder-quobyte-5f2cfd30-0033-4bda-9941-d5df19fbb345-a4a7446d-bad4-450d-9879-f4c025d7434c" released by "_create_volume_from_snapshot" :: held 10.963s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:50:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.023s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:50:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090c8d65-81c6-48c5-ab3e-402fde26fd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4a7446d-bad4-450d-9879-f4c025d7434c', 'volume_size': 1, 'snapshot_id': '5f2cfd30-0033-4bda-9941-d5df19fbb345'}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:50:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0326e1cc-2bdf-4486-85c6-387d10e69f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:50:42 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Volume volume-a4a7446d-bad4-450d-9879-f4c025d7434c (a4a7446d-bad4-450d-9879-f4c025d7434c): created successfully Sep 10 19:50:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0326e1cc-2bdf-4486-85c6-387d10e69f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:50:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Flow 'volume_create_manager' (acdabfd7-3f6a-48bd-a5be-e687564013d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:50:42 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-019b6456-41b7-4b08-9943-9ed1b4d166b4 tempest-TestStampPattern-66311909 None] Created volume successfully. Sep 10 19:50:42 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f3aedb61-f2ef-4ed8-8f1f-85f0c3289d19 tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "cinder-quobyte-3fdda367-1a2c-43d7-a050-5d93c33642fb" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:50:42 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f3aedb61-f2ef-4ed8-8f1f-85f0c3289d19 tempest-GroupSnapshotsTest-901873335 None] Lock "cinder-quobyte-3fdda367-1a2c-43d7-a050-5d93c33642fb" acquired by "delete_volume" :: waited 0.031s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:50:42 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[366757b0-8383-4bc8-b527-27ad1b2548f9]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:50:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f3aedb61-f2ef-4ed8-8f1f-85f0c3289d19 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:42 devstack sudo[97464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb Sep 10 19:50:42 devstack sudo[97464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:43 devstack sudo[97464]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f3aedb61-f2ef-4ed8-8f1f-85f0c3289d19 tempest-GroupSnapshotsTest-901873335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb" returned: 0 in 0.459s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f3aedb61-f2ef-4ed8-8f1f-85f0c3289d19 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:43 devstack sudo[97469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb Sep 10 19:50:43 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:43 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f3aedb61-f2ef-4ed8-8f1f-85f0c3289d19 tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3fdda367-1a2c-43d7-a050-5d93c33642fb" returned: 0 in 0.285s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f3aedb61-f2ef-4ed8-8f1f-85f0c3289d19 tempest-GroupSnapshotsTest-901873335 None] Lock "cinder-quobyte-3fdda367-1a2c-43d7-a050-5d93c33642fb" released by "delete_volume" :: held 0.824s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:50:43 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-f3aedb61-f2ef-4ed8-8f1f-85f0c3289d19 tempest-GroupSnapshotsTest-901873335 None] Created reservations ['ce0ac680-f210-43f3-9c78-0c2e7d88973c'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:50:43 devstack cinder-volume[88093]: WARNING cinder.db.api [None req-f3aedb61-f2ef-4ed8-8f1f-85f0c3289d19 tempest-GroupSnapshotsTest-901873335 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1565342684'] Sep 10 19:50:43 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-f3aedb61-f2ef-4ed8-8f1f-85f0c3289d19 tempest-GroupSnapshotsTest-901873335 None] Created reservations ['7eedf18d-32c6-4a31-88a1-40e58ef0e84a', 'ecf55ec4-e507-45f0-a678-fef0ce308aba', '2c22dbff-c491-40df-8f13-aa3dfad502d6', 'e0ba666b-e19d-4693-a46f-7f6fb9d69c69'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:50:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f3aedb61-f2ef-4ed8-8f1f-85f0c3289d19 tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:50:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f3aedb61-f2ef-4ed8-8f1f-85f0c3289d19 tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:50:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f3aedb61-f2ef-4ed8-8f1f-85f0c3289d19 tempest-GroupSnapshotsTest-901873335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:50:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f3aedb61-f2ef-4ed8-8f1f-85f0c3289d19 tempest-GroupSnapshotsTest-901873335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:50:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f3aedb61-f2ef-4ed8-8f1f-85f0c3289d19 tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:50:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f3aedb61-f2ef-4ed8-8f1f-85f0c3289d19 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:43 devstack sudo[97472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:50:43 devstack sudo[97472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:44 devstack sudo[97472]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f3aedb61-f2ef-4ed8-8f1f-85f0c3289d19 tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.309s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:44 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-f3aedb61-f2ef-4ed8-8f1f-85f0c3289d19 tempest-GroupSnapshotsTest-901873335 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:50:44 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-f3aedb61-f2ef-4ed8-8f1f-85f0c3289d19 tempest-GroupSnapshotsTest-901873335 None] Delete group completed successfully. Sep 10 19:50:44 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-1cedce8d-929f-46a6-bbbb-3d51909d3973 tempest-GroupSnapshotsTest-901873335 None] Group tempest-GroupSnapshotsTest-Group-1906749448: creating Sep 10 19:50:44 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-1cedce8d-929f-46a6-bbbb-3d51909d3973 tempest-GroupSnapshotsTest-901873335 None] Group tempest-GroupSnapshotsTest-Group-1906749448: created successfully Sep 10 19:50:44 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-1cedce8d-929f-46a6-bbbb-3d51909d3973 tempest-GroupSnapshotsTest-901873335 None] Create group completed successfully. Sep 10 19:50:46 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:50:46 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] Flow 'volume_create_manager' (c96f6203-f828-42d7-a6d3-fdf027f02016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:50:46 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7813c138-23bf-45cd-927c-3c7a4cc830da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:50:46 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7813c138-23bf-45cd-927c-3c7a4cc830da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1724569390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0b5f286e-9e6f-4bbf-995c-2819de945e76,host='devstack@QuobyteHD#QuobyteHD',id=ab19183c-023b-43f5-bd18-2f1bf767ce12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47c1cf4d1734498bd0938a6b8580103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:50:46Z,use_quota=True,user_id='d87a09c27876429f852ac9e937f4358f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6117a5f-d61c-4ced-80b9-9bdc9130d187),volume_type_id=c6117a5f-d61c-4ced-80b9-9bdc9130d187)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:50:46 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbd762f9-8d64-4843-864d-3837b5f5809d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:50:46 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbd762f9-8d64-4843-864d-3837b5f5809d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:50:46 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a1ba99-fdcb-45e7-a89d-a09b82c29d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:50:46 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a1ba99-fdcb-45e7-a89d-a09b82c29d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab19183c-023b-43f5-bd18-2f1bf767ce12', 'volume_name': 'volume-ab19183c-023b-43f5-bd18-2f1bf767ce12', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:50:46 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5444d8b8-042c-4bca-a824-a13293f48745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:50:46 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5444d8b8-042c-4bca-a824-a13293f48745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:50:46 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a6b61e8-0d26-428e-99e6-1f7f78a40de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:50:46 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] Volume ab19183c-023b-43f5-bd18-2f1bf767ce12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab19183c-023b-43f5-bd18-2f1bf767ce12', 'volume_size': 1} Sep 10 19:50:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:50:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:50:46 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0b5f286e-9e6f-4bbf-995c-2819de945e76,created_at=2026-09-10T17:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1724569390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0b5f286e-9e6f-4bbf-995c-2819de945e76,host='devstack@QuobyteHD#QuobyteHD',id=ab19183c-023b-43f5-bd18-2f1bf767ce12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47c1cf4d1734498bd0938a6b8580103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:50:46Z,use_quota=True,user_id='d87a09c27876429f852ac9e937f4358f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6117a5f-d61c-4ced-80b9-9bdc9130d187),volume_type_id=c6117a5f-d61c-4ced-80b9-9bdc9130d187)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:50:46 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] Creating volume ab19183c-023b-43f5-bd18-2f1bf767ce12 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:50:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:50:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:50:46 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:50:46 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:50:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:50:46 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:50:46 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:50:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:46 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12 1073741824 Sep 10 19:50:46 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:46 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12 1073741824" returned: 0 in 0.450s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:47 devstack sudo[97504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12 Sep 10 19:50:47 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:47 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12" returned: 0 in 0.303s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:47 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:50:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:50:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a6b61e8-0d26-428e-99e6-1f7f78a40de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab19183c-023b-43f5-bd18-2f1bf767ce12', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:50:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a952cd4-78f9-4f7a-86a7-bbc3098a6578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:50:47 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] Volume volume-ab19183c-023b-43f5-bd18-2f1bf767ce12 (ab19183c-023b-43f5-bd18-2f1bf767ce12): created successfully Sep 10 19:50:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a952cd4-78f9-4f7a-86a7-bbc3098a6578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:50:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] Flow 'volume_create_manager' (c96f6203-f828-42d7-a6d3-fdf027f02016) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:50:47 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-5326bf65-09ec-461e-96d7-0a18b83d5145 tempest-GroupSnapshotsTest-901873335 None] Created volume successfully. Sep 10 19:50:49 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:50:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] Flow 'volume_create_manager' (07a14d10-2b59-4e6c-81cf-91a0698080d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:50:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ff0609-ae8c-4af6-b4ad-1680a69ff991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:50:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ff0609-ae8c-4af6-b4ad-1680a69ff991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-348379527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0b5f286e-9e6f-4bbf-995c-2819de945e76,host='devstack@QuobyteHD#QuobyteHD',id=da65ba68-0432-4592-9a47-ffa5bd7d731f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47c1cf4d1734498bd0938a6b8580103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:50:49Z,use_quota=True,user_id='d87a09c27876429f852ac9e937f4358f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6117a5f-d61c-4ced-80b9-9bdc9130d187),volume_type_id=c6117a5f-d61c-4ced-80b9-9bdc9130d187)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:50:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6618dc4e-bc54-42df-9944-0e0a8e8a803d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:50:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6618dc4e-bc54-42df-9944-0e0a8e8a803d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:50:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66741c4f-822f-4ada-a13b-69f7d20a3e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:50:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66741c4f-822f-4ada-a13b-69f7d20a3e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da65ba68-0432-4592-9a47-ffa5bd7d731f', 'volume_name': 'volume-da65ba68-0432-4592-9a47-ffa5bd7d731f', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:50:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace9dba4-2929-4cec-a3ec-82f5623e25f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:50:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace9dba4-2929-4cec-a3ec-82f5623e25f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:50:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac29e12-d5c6-48a6-a995-cb663f43fbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:50:49 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] Volume da65ba68-0432-4592-9a47-ffa5bd7d731f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da65ba68-0432-4592-9a47-ffa5bd7d731f', 'volume_size': 1} Sep 10 19:50:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:50:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:50:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0b5f286e-9e6f-4bbf-995c-2819de945e76,created_at=2026-09-10T17:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-348379527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0b5f286e-9e6f-4bbf-995c-2819de945e76,host='devstack@QuobyteHD#QuobyteHD',id=da65ba68-0432-4592-9a47-ffa5bd7d731f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47c1cf4d1734498bd0938a6b8580103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:50:49Z,use_quota=True,user_id='d87a09c27876429f852ac9e937f4358f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6117a5f-d61c-4ced-80b9-9bdc9130d187),volume_type_id=c6117a5f-d61c-4ced-80b9-9bdc9130d187)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:50:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] Creating volume da65ba68-0432-4592-9a47-ffa5bd7d731f {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:50:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:50:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:50:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:50:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:50:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:50:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:50:49 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:50:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:49 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f 1073741824 Sep 10 19:50:49 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:50 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f 1073741824" returned: 0 in 0.742s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:50 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f Sep 10 19:50:50 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:50 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f" returned: 0 in 0.427s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:50 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:50:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:50:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac29e12-d5c6-48a6-a995-cb663f43fbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da65ba68-0432-4592-9a47-ffa5bd7d731f', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:50:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0a2116-c264-4e7b-b537-71bd30dcbdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:50:51 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] Volume volume-da65ba68-0432-4592-9a47-ffa5bd7d731f (da65ba68-0432-4592-9a47-ffa5bd7d731f): created successfully Sep 10 19:50:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0a2116-c264-4e7b-b537-71bd30dcbdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:50:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] Flow 'volume_create_manager' (07a14d10-2b59-4e6c-81cf-91a0698080d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:50:51 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-d8eb96d7-84ef-4fe9-80ab-9d9458f7a4e2 tempest-GroupSnapshotsTest-901873335 None] Created volume successfully. Sep 10 19:50:52 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-ac98c2a5-8321-4b63-b741-647f9a2114be tempest-GroupSnapshotsTest-901873335 None] Update group completed successfully. Sep 10 19:50:53 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-0def3eb2-0518-4140-8d56-a3e37a492ead tempest-GroupSnapshotsTest-901873335 None] Update group completed successfully. Sep 10 19:50:54 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-0828c07b-5713-4a40-b606-26e9f49e4389 tempest-GroupSnapshotsTest-901873335 None] Update group completed successfully. Sep 10 19:50:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-6e53fd57-7893-4af0-9ce5-8909cea182b9 req-5eb57d18-3304-430e-bf6d-d521a9590b4d tempest-TestStampPattern-66311909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:50:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-6e53fd57-7893-4af0-9ce5-8909cea182b9 req-5eb57d18-3304-430e-bf6d-d521a9590b4d tempest-TestStampPattern-66311909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:50:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-6e53fd57-7893-4af0-9ce5-8909cea182b9 req-5eb57d18-3304-430e-bf6d-d521a9590b4d tempest-TestStampPattern-66311909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:50:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-6e53fd57-7893-4af0-9ce5-8909cea182b9 req-5eb57d18-3304-430e-bf6d-d521a9590b4d tempest-TestStampPattern-66311909 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3', 'name': 'volume-a4a7446d-bad4-450d-9879-f4c025d7434c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0524b257-4ccd-429e-a781-22992db6f94b', 'enforce_multipath': True} {{(pid=88093) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 19:50:55 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-6e53fd57-7893-4af0-9ce5-8909cea182b9 req-5eb57d18-3304-430e-bf6d-d521a9590b4d tempest-TestStampPattern-66311909 None] attachment_update completed successfully. Sep 10 19:50:56 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-983ad785-f462-4da4-a53b-faecb2d38325 tempest-GroupSnapshotsTest-901873335 None] Update group completed successfully. Sep 10 19:50:58 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] GroupSnapshot 7bd7c4de-773a-4dce-a21e-6a7da51e9426: creating. Sep 10 19:50:58 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] Group snapshot 7bd7c4de-773a-4dce-a21e-6a7da51e9426: creating. {{(pid=88093) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 10 19:50:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:50:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:50:58 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] Creating offline snapshot 20522bbd-4ea2-4549-8aac-4a0006a63587 of volume da65ba68-0432-4592-9a47-ffa5bd7d731f {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 19:50:58 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01230eb-36d4-4d79-b420-ce5d3f038409]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:50:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:58 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f Sep 10 19:50:58 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:59 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f" returned: 0 in 0.621s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f.20522bbd-4ea2-4549-8aac-4a0006a63587 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:59 devstack sudo[98025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f.20522bbd-4ea2-4549-8aac-4a0006a63587 1G Sep 10 19:50:59 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:50:59 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-e342ba60-0c77-493b-9ee7-e0de598320aa req-71949a5c-cc6c-4e58-a95a-46b12ed311c6 tempest-TestStampPattern-66311909 None] Terminate volume connection completed successfully. Sep 10 19:50:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-e342ba60-0c77-493b-9ee7-e0de598320aa req-71949a5c-cc6c-4e58-a95a-46b12ed311c6 tempest-TestStampPattern-66311909 None] Deleting attachment 0524b257-4ccd-429e-a781-22992db6f94b. {{(pid=88093) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 19:50:59 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root Sep 10 19:50:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f.20522bbd-4ea2-4549-8aac-4a0006a63587 1G" returned: 0 in 0.707s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:50:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da65ba68-0432-4592-9a47-ffa5bd7d731f -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f.20522bbd-4ea2-4549-8aac-4a0006a63587 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:50:59 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da65ba68-0432-4592-9a47-ffa5bd7d731f -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f.20522bbd-4ea2-4549-8aac-4a0006a63587 Sep 10 19:50:59 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:00 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da65ba68-0432-4592-9a47-ffa5bd7d731f -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f.20522bbd-4ea2-4549-8aac-4a0006a63587" returned: 0 in 0.668s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:00 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f.20522bbd-4ea2-4549-8aac-4a0006a63587 is being set with open permissions: ugo+rw: NotImplementedError Sep 10 19:51:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f.20522bbd-4ea2-4549-8aac-4a0006a63587 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:00 devstack sudo[98065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f.20522bbd-4ea2-4549-8aac-4a0006a63587 Sep 10 19:51:00 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:00 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f.20522bbd-4ea2-4549-8aac-4a0006a63587" returned: 0 in 0.577s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:00 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=88,cinder:UPDATE=84,cinder:DELETE=3,cinder:INSERT=16 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:51:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:01 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f.info Sep 10 19:51:01 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:01 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f.info" returned: 0 in 0.334s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:01 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 10 19:51:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:01 devstack sudo[98073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f.info Sep 10 19:51:01 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:01 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f.info" returned: 0 in 0.325s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.404s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:01 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] Creating offline snapshot 72501139-571d-43c4-ac41-2aefe2130136 of volume ab19183c-023b-43f5-bd18-2f1bf767ce12 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 19:51:01 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[67441d82-2b88-4a1f-b48c-a068738356d4]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:51:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:02 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12 Sep 10 19:51:02 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:02 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12" returned: 0 in 0.683s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12.72501139-571d-43c4-ac41-2aefe2130136 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:02 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12.72501139-571d-43c4-ac41-2aefe2130136 1G Sep 10 19:51:02 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:03 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12.72501139-571d-43c4-ac41-2aefe2130136 1G" returned: 0 in 0.898s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab19183c-023b-43f5-bd18-2f1bf767ce12 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12.72501139-571d-43c4-ac41-2aefe2130136 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:03 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab19183c-023b-43f5-bd18-2f1bf767ce12 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12.72501139-571d-43c4-ac41-2aefe2130136 Sep 10 19:51:03 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:03 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab19183c-023b-43f5-bd18-2f1bf767ce12 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12.72501139-571d-43c4-ac41-2aefe2130136" returned: 0 in 0.420s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:03 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12.72501139-571d-43c4-ac41-2aefe2130136 is being set with open permissions: ugo+rw: NotImplementedError Sep 10 19:51:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12.72501139-571d-43c4-ac41-2aefe2130136 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:03 devstack sudo[98120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12.72501139-571d-43c4-ac41-2aefe2130136 Sep 10 19:51:03 devstack sudo[98120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:03 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:51:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:51:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:51:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:03 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:51:03 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:04 devstack sudo[98120]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12.72501139-571d-43c4-ac41-2aefe2130136" returned: 0 in 0.545s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:04 devstack sudo[98127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12.info Sep 10 19:51:04 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:04 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.599s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:04 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:51:04 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager._thread_info {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:51:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread count: 28 {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 19:51:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread info: [<_MainThread(MainThread, started 138417491665024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 19:51:04 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12.info" returned: 0 in 0.537s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:04 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12.info is being set with open permissions: ugo+rw: NotImplementedError Sep 10 19:51:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:05 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12.info Sep 10 19:51:05 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:05 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12.info" returned: 0 in 0.453s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.697s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:05 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-f4a989b0-495a-4370-bae3-e0e1c1245bdd tempest-GroupSnapshotsTest-901873335 None] group_snapshot 7bd7c4de-773a-4dce-a21e-6a7da51e9426: created successfully Sep 10 19:51:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-208a0de2-30e0-4230-81b5-c6351749dd0c tempest-TestStampPattern-66311909 None] Acquiring lock "cinder-a4a7446d-bad4-450d-9879-f4c025d7434c-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:51:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-208a0de2-30e0-4230-81b5-c6351749dd0c tempest-TestStampPattern-66311909 None] Lock "cinder-a4a7446d-bad4-450d-9879-f4c025d7434c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:51:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-208a0de2-30e0-4230-81b5-c6351749dd0c tempest-TestStampPattern-66311909 None] Acquiring lock "cinder-quobyte-a4a7446d-bad4-450d-9879-f4c025d7434c" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:51:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-208a0de2-30e0-4230-81b5-c6351749dd0c tempest-TestStampPattern-66311909 None] Lock "cinder-quobyte-a4a7446d-bad4-450d-9879-f4c025d7434c" acquired by "delete_volume" :: waited 0.032s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:51:06 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] group_snapshot 7bd7c4de-773a-4dce-a21e-6a7da51e9426: deleting Sep 10 19:51:06 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a357b1-7bb5-46f9-aab6-d9fe4a693c90]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:51:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-208a0de2-30e0-4230-81b5-c6351749dd0c tempest-TestStampPattern-66311909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a4a7446d-bad4-450d-9879-f4c025d7434c {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] group_snapshot 7bd7c4de-773a-4dce-a21e-6a7da51e9426: deleting {{(pid=88093) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 10 19:51:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "cinder-quobyte-da65ba68-0432-4592-9a47-ffa5bd7d731f" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:51:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] Lock "cinder-quobyte-da65ba68-0432-4592-9a47-ffa5bd7d731f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:51:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "cinder-quobyte-20522bbd-4ea2-4549-8aac-4a0006a63587" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:51:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] Lock "cinder-quobyte-20522bbd-4ea2-4549-8aac-4a0006a63587" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:51:06 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] Deleting offline snapshot 20522bbd-4ea2-4549-8aac-4a0006a63587 of volume da65ba68-0432-4592-9a47-ffa5bd7d731f {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 19:51:06 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] snapshot_file for this snap is: volume-da65ba68-0432-4592-9a47-ffa5bd7d731f.20522bbd-4ea2-4549-8aac-4a0006a63587 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 19:51:06 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[07654f5e-5963-452d-9838-a7def37504ae]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:51:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f.20522bbd-4ea2-4549-8aac-4a0006a63587 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:06 devstack sudo[98134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a4a7446d-bad4-450d-9879-f4c025d7434c Sep 10 19:51:06 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:06 devstack sudo[98135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f.20522bbd-4ea2-4549-8aac-4a0006a63587 Sep 10 19:51:06 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:06 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-208a0de2-30e0-4230-81b5-c6351749dd0c tempest-TestStampPattern-66311909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a4a7446d-bad4-450d-9879-f4c025d7434c" returned: 0 in 0.562s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-208a0de2-30e0-4230-81b5-c6351749dd0c tempest-TestStampPattern-66311909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a4a7446d-bad4-450d-9879-f4c025d7434c {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:06 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a4a7446d-bad4-450d-9879-f4c025d7434c Sep 10 19:51:06 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:06 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f.20522bbd-4ea2-4549-8aac-4a0006a63587" returned: 0 in 0.488s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:06 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da65ba68-0432-4592-9a47-ffa5bd7d731f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:51:06 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4e6456-92cc-433c-a57c-63212fc1c66c]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:51:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:07 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-208a0de2-30e0-4230-81b5-c6351749dd0c tempest-TestStampPattern-66311909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a4a7446d-bad4-450d-9879-f4c025d7434c" returned: 0 in 0.270s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:07 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f Sep 10 19:51:07 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-208a0de2-30e0-4230-81b5-c6351749dd0c tempest-TestStampPattern-66311909 None] Lock "cinder-quobyte-a4a7446d-bad4-450d-9879-f4c025d7434c" released by "delete_volume" :: held 0.892s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:51:07 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-208a0de2-30e0-4230-81b5-c6351749dd0c tempest-TestStampPattern-66311909 None] Created reservations ['0b370ee6-58b2-4b4e-a381-4e9927fbb483', 'bdc8e3c9-84c9-4a01-b9e5-cfa2972e1f5f', '3b2406a6-15d9-4830-bedc-6d398c7fe5d8', '152b9fff-bfac-400a-a59c-e175d830528f'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:51:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-208a0de2-30e0-4230-81b5-c6351749dd0c tempest-TestStampPattern-66311909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-208a0de2-30e0-4230-81b5-c6351749dd0c tempest-TestStampPattern-66311909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-208a0de2-30e0-4230-81b5-c6351749dd0c tempest-TestStampPattern-66311909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:51:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-208a0de2-30e0-4230-81b5-c6351749dd0c tempest-TestStampPattern-66311909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:51:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-208a0de2-30e0-4230-81b5-c6351749dd0c tempest-TestStampPattern-66311909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-208a0de2-30e0-4230-81b5-c6351749dd0c tempest-TestStampPattern-66311909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:07 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:51:07 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:07 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f" returned: 0 in 0.459s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f.20522bbd-4ea2-4549-8aac-4a0006a63587 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:07 devstack sudo[98154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f.20522bbd-4ea2-4549-8aac-4a0006a63587 Sep 10 19:51:07 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1c9c7053-e56b-4076-b35c-0bbc07d3a093 tempest-TestStampPattern-66311909 None] Acquiring lock "cinder-5f2cfd30-0033-4bda-9941-d5df19fbb345-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:51:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1c9c7053-e56b-4076-b35c-0bbc07d3a093 tempest-TestStampPattern-66311909 None] Lock "cinder-5f2cfd30-0033-4bda-9941-d5df19fbb345-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:51:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1c9c7053-e56b-4076-b35c-0bbc07d3a093 tempest-TestStampPattern-66311909 None] Acquiring lock "cinder-quobyte-c954c5f1-195a-455d-95ba-f237c1f45781" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:51:07 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-208a0de2-30e0-4230-81b5-c6351749dd0c tempest-TestStampPattern-66311909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.595s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:07 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-208a0de2-30e0-4230-81b5-c6351749dd0c tempest-TestStampPattern-66311909 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:51:07 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-208a0de2-30e0-4230-81b5-c6351749dd0c tempest-TestStampPattern-66311909 None] Deleted volume successfully. Sep 10 19:51:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1c9c7053-e56b-4076-b35c-0bbc07d3a093 tempest-TestStampPattern-66311909 None] Lock "cinder-quobyte-c954c5f1-195a-455d-95ba-f237c1f45781" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:51:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1c9c7053-e56b-4076-b35c-0bbc07d3a093 tempest-TestStampPattern-66311909 None] Acquiring lock "cinder-quobyte-5f2cfd30-0033-4bda-9941-d5df19fbb345" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:51:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-208a0de2-30e0-4230-81b5-c6351749dd0c tempest-TestStampPattern-66311909 None] Lock "cinder-a4a7446d-bad4-450d-9879-f4c025d7434c-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:51:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1c9c7053-e56b-4076-b35c-0bbc07d3a093 tempest-TestStampPattern-66311909 None] Lock "cinder-quobyte-5f2cfd30-0033-4bda-9941-d5df19fbb345" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:51:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-1c9c7053-e56b-4076-b35c-0bbc07d3a093 tempest-TestStampPattern-66311909 None] Deleting offline snapshot 5f2cfd30-0033-4bda-9941-d5df19fbb345 of volume c954c5f1-195a-455d-95ba-f237c1f45781 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 19:51:08 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-1c9c7053-e56b-4076-b35c-0bbc07d3a093 tempest-TestStampPattern-66311909 None] snapshot_file for this snap is: volume-c954c5f1-195a-455d-95ba-f237c1f45781.5f2cfd30-0033-4bda-9941-d5df19fbb345 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 19:51:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f.20522bbd-4ea2-4549-8aac-4a0006a63587" returned: 0 in 0.618s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f.20522bbd-4ea2-4549-8aac-4a0006a63587 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:08 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf988721-c229-4ad1-9b80-c5d17644a122]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:51:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1c9c7053-e56b-4076-b35c-0bbc07d3a093 tempest-TestStampPattern-66311909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781.5f2cfd30-0033-4bda-9941-d5df19fbb345 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:08 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f.20522bbd-4ea2-4549-8aac-4a0006a63587 Sep 10 19:51:08 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:08 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781.5f2cfd30-0033-4bda-9941-d5df19fbb345 Sep 10 19:51:08 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:08 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f.20522bbd-4ea2-4549-8aac-4a0006a63587" returned: 0 in 0.329s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] Lock "cinder-quobyte-20522bbd-4ea2-4549-8aac-4a0006a63587" released by "_delete_snapshot" :: held 2.029s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:51:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] Lock "cinder-quobyte-da65ba68-0432-4592-9a47-ffa5bd7d731f" released by "delete_snapshot" :: held 2.071s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:51:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "cinder-quobyte-ab19183c-023b-43f5-bd18-2f1bf767ce12" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:51:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] Lock "cinder-quobyte-ab19183c-023b-43f5-bd18-2f1bf767ce12" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:51:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "cinder-quobyte-72501139-571d-43c4-ac41-2aefe2130136" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:51:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] Lock "cinder-quobyte-72501139-571d-43c4-ac41-2aefe2130136" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:51:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] Deleting offline snapshot 72501139-571d-43c4-ac41-2aefe2130136 of volume ab19183c-023b-43f5-bd18-2f1bf767ce12 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 19:51:08 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] snapshot_file for this snap is: volume-ab19183c-023b-43f5-bd18-2f1bf767ce12.72501139-571d-43c4-ac41-2aefe2130136 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 19:51:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1c9c7053-e56b-4076-b35c-0bbc07d3a093 tempest-TestStampPattern-66311909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781.5f2cfd30-0033-4bda-9941-d5df19fbb345" returned: 0 in 0.457s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-1c9c7053-e56b-4076-b35c-0bbc07d3a093 tempest-TestStampPattern-66311909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c954c5f1-195a-455d-95ba-f237c1f45781(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:51:08 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ea22f0-2ad5-43a3-8bcf-339817a3c1ee]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:51:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12.72501139-571d-43c4-ac41-2aefe2130136 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:08 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3af24d-3204-4d49-b99c-67540a701a8e]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:51:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1c9c7053-e56b-4076-b35c-0bbc07d3a093 tempest-TestStampPattern-66311909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:08 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781 Sep 10 19:51:08 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:08 devstack sudo[98169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12.72501139-571d-43c4-ac41-2aefe2130136 Sep 10 19:51:08 devstack sudo[98169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:09 devstack sudo[98169]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12.72501139-571d-43c4-ac41-2aefe2130136" returned: 0 in 0.508s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:09 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab19183c-023b-43f5-bd18-2f1bf767ce12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:51:09 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[436afa37-cf3a-46b3-ade9-56c9ec567be6]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:51:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:09 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1c9c7053-e56b-4076-b35c-0bbc07d3a093 tempest-TestStampPattern-66311909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781" returned: 0 in 0.661s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1c9c7053-e56b-4076-b35c-0bbc07d3a093 tempest-TestStampPattern-66311909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781.5f2cfd30-0033-4bda-9941-d5df19fbb345 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:09 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12 Sep 10 19:51:09 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:09 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781.5f2cfd30-0033-4bda-9941-d5df19fbb345 Sep 10 19:51:09 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:09 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12" returned: 0 in 0.437s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12.72501139-571d-43c4-ac41-2aefe2130136 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:09 devstack sudo[98189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12.72501139-571d-43c4-ac41-2aefe2130136 Sep 10 19:51:09 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:09 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1c9c7053-e56b-4076-b35c-0bbc07d3a093 tempest-TestStampPattern-66311909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781.5f2cfd30-0033-4bda-9941-d5df19fbb345" returned: 0 in 0.485s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1c9c7053-e56b-4076-b35c-0bbc07d3a093 tempest-TestStampPattern-66311909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781.5f2cfd30-0033-4bda-9941-d5df19fbb345 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:09 devstack sudo[98193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781.5f2cfd30-0033-4bda-9941-d5df19fbb345 Sep 10 19:51:09 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:10 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12.72501139-571d-43c4-ac41-2aefe2130136" returned: 0 in 0.489s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12.72501139-571d-43c4-ac41-2aefe2130136 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:10 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1c9c7053-e56b-4076-b35c-0bbc07d3a093 tempest-TestStampPattern-66311909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781.5f2cfd30-0033-4bda-9941-d5df19fbb345" returned: 0 in 0.340s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:10 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12.72501139-571d-43c4-ac41-2aefe2130136 Sep 10 19:51:10 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1c9c7053-e56b-4076-b35c-0bbc07d3a093 tempest-TestStampPattern-66311909 None] Lock "cinder-quobyte-5f2cfd30-0033-4bda-9941-d5df19fbb345" released by "_delete_snapshot" :: held 2.088s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:51:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1c9c7053-e56b-4076-b35c-0bbc07d3a093 tempest-TestStampPattern-66311909 None] Lock "cinder-quobyte-c954c5f1-195a-455d-95ba-f237c1f45781" released by "delete_snapshot" :: held 2.143s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:51:10 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-1c9c7053-e56b-4076-b35c-0bbc07d3a093 tempest-TestStampPattern-66311909 None] Created reservations ['4ec08738-9509-453e-b358-38780e9f490c', 'b594e299-cf05-4aaa-90b8-1b83a24d5d8c', '6eb03afb-febd-4ae5-8efb-2afdfd6f2b8a', '489ffdf9-f729-4ac6-9d74-1be90d1cb725'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:51:10 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-1c9c7053-e56b-4076-b35c-0bbc07d3a093 tempest-TestStampPattern-66311909 None] Delete snapshot completed successfully. Sep 10 19:51:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1c9c7053-e56b-4076-b35c-0bbc07d3a093 tempest-TestStampPattern-66311909 None] Lock "cinder-5f2cfd30-0033-4bda-9941-d5df19fbb345-delete_snapshot" released by "delete_snapshot" :: held 2.373s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:51:10 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12.72501139-571d-43c4-ac41-2aefe2130136" returned: 0 in 0.337s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] Lock "cinder-quobyte-72501139-571d-43c4-ac41-2aefe2130136" released by "_delete_snapshot" :: held 1.900s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:51:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] Lock "cinder-quobyte-ab19183c-023b-43f5-bd18-2f1bf767ce12" released by "delete_snapshot" :: held 1.926s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:51:10 devstack cinder-volume[88093]: WARNING cinder.quota [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1835436916 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1835436916, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:51:10 devstack cinder-volume[88093]: WARNING cinder.quota [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1835436916 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1835436916, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:51:10 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] Created reservations ['15867893-44f7-40cb-a48c-01d87f166b09', 'c33686c5-095b-494a-b2ef-ac06af684289', '93722748-35b6-45c4-9117-16239786562d', '99be3ca1-1822-48f7-9fab-146772ca8ea7'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:51:10 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] Created reservations ['aaeeb73c-2602-4858-98b3-5a187ff2fa68', '9a0e7061-9b35-410d-bf0a-01bc54b505cc', 'e40853ab-c67f-4f71-a538-515567763e35', 'ece9ed0a-71b7-4a8e-8731-0be168037e3f'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:51:10 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-f2a37c7b-7eaa-4d43-b416-966a2119d4f1 tempest-GroupSnapshotsTest-901873335 None] group_snapshot 7bd7c4de-773a-4dce-a21e-6a7da51e9426: deleted successfully Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] Flow 'volume_create_manager' (f8e08b4e-25fa-4fd3-85ac-44b3fd6411f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bd372d0-2924-4f89-9f4b-12a75e4641fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bd372d0-2924-4f89-9f4b-12a75e4641fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1280313764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=873c2693-d08d-40a9-8838-198a7fe0d7cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='843bc3bafd2f4fcb8edb1c4d2f7abd68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:51:11Z,use_quota=True,user_id='79e701e9772c41b1b07f1b575f8fec93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b724113d-a8fc-455c-81ae-1d1979abb566),volume_type_id=b724113d-a8fc-455c-81ae-1d1979abb566)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27973cd-1d3f-4ce5-bd94-458fb1c80aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27973cd-1d3f-4ce5-bd94-458fb1c80aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (626c026c-a313-43b3-aa46-2d2c381c74f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (626c026c-a313-43b3-aa46-2d2c381c74f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '873c2693-d08d-40a9-8838-198a7fe0d7cd', 'volume_name': 'volume-873c2693-d08d-40a9-8838-198a7fe0d7cd', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfe80ef6-b2fc-4b13-8e4a-dfd87d940519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfe80ef6-b2fc-4b13-8e4a-dfd87d940519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a263738-ec9a-4201-b906-deed64ec4a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:11 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] Volume 873c2693-d08d-40a9-8838-198a7fe0d7cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-873c2693-d08d-40a9-8838-198a7fe0d7cd', 'volume_size': 1} Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1280313764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=873c2693-d08d-40a9-8838-198a7fe0d7cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='843bc3bafd2f4fcb8edb1c4d2f7abd68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:51:11Z,use_quota=True,user_id='79e701e9772c41b1b07f1b575f8fec93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b724113d-a8fc-455c-81ae-1d1979abb566),volume_type_id=b724113d-a8fc-455c-81ae-1d1979abb566)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] Creating volume 873c2693-d08d-40a9-8838-198a7fe0d7cd {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:51:11 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-873c2693-d08d-40a9-8838-198a7fe0d7cd 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:11 devstack sudo[98229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-873c2693-d08d-40a9-8838-198a7fe0d7cd 1073741824 Sep 10 19:51:11 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-fab8ca48-b8df-439f-8a0d-d97bf863676b tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "cinder-quobyte-ab19183c-023b-43f5-bd18-2f1bf767ce12" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-fab8ca48-b8df-439f-8a0d-d97bf863676b tempest-GroupSnapshotsTest-901873335 None] Lock "cinder-quobyte-ab19183c-023b-43f5-bd18-2f1bf767ce12" acquired by "delete_volume" :: waited 0.017s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d28bc37-6f3f-42f6-aea0-07b1b86d6087]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fab8ca48-b8df-439f-8a0d-d97bf863676b tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:11 devstack sudo[98235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12 Sep 10 19:51:11 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:11 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-873c2693-d08d-40a9-8838-198a7fe0d7cd 1073741824" returned: 0 in 0.534s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-873c2693-d08d-40a9-8838-198a7fe0d7cd {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:11 devstack sudo[98237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-873c2693-d08d-40a9-8838-198a7fe0d7cd Sep 10 19:51:11 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:11 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:11 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-873c2693-d08d-40a9-8838-198a7fe0d7cd" returned: 0 in 0.311s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fab8ca48-b8df-439f-8a0d-d97bf863676b tempest-GroupSnapshotsTest-901873335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12" returned: 0 in 0.505s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fab8ca48-b8df-439f-8a0d-d97bf863676b tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a263738-ec9a-4201-b906-deed64ec4a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-873c2693-d08d-40a9-8838-198a7fe0d7cd', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:12 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12 Sep 10 19:51:12 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb9d9bf-723a-4d4d-8e91-21832a1174c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:12 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] Volume volume-873c2693-d08d-40a9-8838-198a7fe0d7cd (873c2693-d08d-40a9-8838-198a7fe0d7cd): created successfully Sep 10 19:51:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb9d9bf-723a-4d4d-8e91-21832a1174c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] Flow 'volume_create_manager' (f8e08b4e-25fa-4fd3-85ac-44b3fd6411f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:51:12 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-ba461a27-845d-4590-bb10-8b5de1096a84 tempest-VolumeTypesAccessTest-81959042 None] Created volume successfully. Sep 10 19:51:12 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fab8ca48-b8df-439f-8a0d-d97bf863676b tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab19183c-023b-43f5-bd18-2f1bf767ce12" returned: 0 in 0.357s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:12 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-fab8ca48-b8df-439f-8a0d-d97bf863676b tempest-GroupSnapshotsTest-901873335 None] Lock "cinder-quobyte-ab19183c-023b-43f5-bd18-2f1bf767ce12" released by "delete_volume" :: held 0.933s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:51:12 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-fab8ca48-b8df-439f-8a0d-d97bf863676b tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "cinder-quobyte-da65ba68-0432-4592-9a47-ffa5bd7d731f" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:51:12 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-fab8ca48-b8df-439f-8a0d-d97bf863676b tempest-GroupSnapshotsTest-901873335 None] Lock "cinder-quobyte-da65ba68-0432-4592-9a47-ffa5bd7d731f" acquired by "delete_volume" :: waited 0.016s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:51:12 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5a6ad7-848d-473f-bdb0-446672d07869]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:51:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fab8ca48-b8df-439f-8a0d-d97bf863676b tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:12 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f Sep 10 19:51:12 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:12 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fab8ca48-b8df-439f-8a0d-d97bf863676b tempest-GroupSnapshotsTest-901873335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f" returned: 0 in 0.557s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fab8ca48-b8df-439f-8a0d-d97bf863676b tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:13 devstack sudo[98275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f Sep 10 19:51:13 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:13 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1a71ef78-2c00-4015-ae0a-0ba931cd97d1 tempest-VolumeTypesAccessTest-81959042 None] Acquiring lock "cinder-873c2693-d08d-40a9-8838-198a7fe0d7cd-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:51:13 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1a71ef78-2c00-4015-ae0a-0ba931cd97d1 tempest-VolumeTypesAccessTest-81959042 None] Lock "cinder-873c2693-d08d-40a9-8838-198a7fe0d7cd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:51:13 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1a71ef78-2c00-4015-ae0a-0ba931cd97d1 tempest-VolumeTypesAccessTest-81959042 None] Acquiring lock "cinder-quobyte-873c2693-d08d-40a9-8838-198a7fe0d7cd" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:51:13 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1a71ef78-2c00-4015-ae0a-0ba931cd97d1 tempest-VolumeTypesAccessTest-81959042 None] Lock "cinder-quobyte-873c2693-d08d-40a9-8838-198a7fe0d7cd" acquired by "delete_volume" :: waited 0.023s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:51:13 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d58c1a-a91a-4fb3-96fb-c76935565b58]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:51:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1a71ef78-2c00-4015-ae0a-0ba931cd97d1 tempest-VolumeTypesAccessTest-81959042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-873c2693-d08d-40a9-8838-198a7fe0d7cd {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:13 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fab8ca48-b8df-439f-8a0d-d97bf863676b tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-da65ba68-0432-4592-9a47-ffa5bd7d731f" returned: 0 in 0.341s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:13 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-fab8ca48-b8df-439f-8a0d-d97bf863676b tempest-GroupSnapshotsTest-901873335 None] Lock "cinder-quobyte-da65ba68-0432-4592-9a47-ffa5bd7d731f" released by "delete_volume" :: held 0.990s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:51:13 devstack sudo[98279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-873c2693-d08d-40a9-8838-198a7fe0d7cd Sep 10 19:51:13 devstack sudo[98279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:13 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-fab8ca48-b8df-439f-8a0d-d97bf863676b tempest-GroupSnapshotsTest-901873335 None] Created reservations ['637682aa-23fe-4305-96cd-f5f0e848e71e'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:51:13 devstack cinder-volume[88093]: WARNING cinder.quota [None req-fab8ca48-b8df-439f-8a0d-d97bf863676b tempest-GroupSnapshotsTest-901873335 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1835436916 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1835436916, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:51:13 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-fab8ca48-b8df-439f-8a0d-d97bf863676b tempest-GroupSnapshotsTest-901873335 None] Created reservations ['2fb9b6bf-ea98-43ca-b07a-228abeded93b', 'a16457a2-5775-4bd0-8962-7dd6520285a5', 'b65dcee4-b28c-4e62-be9a-a06f970a7eb7', 'c3c90b26-bf5a-44c5-9f3b-b801cadbd8b8'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:51:13 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-fab8ca48-b8df-439f-8a0d-d97bf863676b tempest-GroupSnapshotsTest-901873335 None] Created reservations ['e8a8c95c-0f22-4a63-bb7f-3d160904a30d', '9876433d-e75d-4503-8d1d-99a778194fe8', '06ac419d-4dc9-4ffd-82d4-ad90a100d37b', '0aadfd36-361d-43f4-be65-4fab2a93f3c9'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:51:13 devstack sudo[98279]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1a71ef78-2c00-4015-ae0a-0ba931cd97d1 tempest-VolumeTypesAccessTest-81959042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-873c2693-d08d-40a9-8838-198a7fe0d7cd" returned: 0 in 0.483s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1a71ef78-2c00-4015-ae0a-0ba931cd97d1 tempest-VolumeTypesAccessTest-81959042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-873c2693-d08d-40a9-8838-198a7fe0d7cd {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:13 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-873c2693-d08d-40a9-8838-198a7fe0d7cd Sep 10 19:51:13 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-fab8ca48-b8df-439f-8a0d-d97bf863676b tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-fab8ca48-b8df-439f-8a0d-d97bf863676b tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:13 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-fab8ca48-b8df-439f-8a0d-d97bf863676b tempest-GroupSnapshotsTest-901873335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:51:13 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-fab8ca48-b8df-439f-8a0d-d97bf863676b tempest-GroupSnapshotsTest-901873335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:51:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-fab8ca48-b8df-439f-8a0d-d97bf863676b tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fab8ca48-b8df-439f-8a0d-d97bf863676b tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:13 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:51:13 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:14 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1a71ef78-2c00-4015-ae0a-0ba931cd97d1 tempest-VolumeTypesAccessTest-81959042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-873c2693-d08d-40a9-8838-198a7fe0d7cd" returned: 0 in 0.395s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1a71ef78-2c00-4015-ae0a-0ba931cd97d1 tempest-VolumeTypesAccessTest-81959042 None] Lock "cinder-quobyte-873c2693-d08d-40a9-8838-198a7fe0d7cd" released by "delete_volume" :: held 0.943s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:51:14 devstack cinder-volume[88093]: WARNING cinder.quota [None req-1a71ef78-2c00-4015-ae0a-0ba931cd97d1 tempest-VolumeTypesAccessTest-81959042 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1589709443 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1589709443, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:51:14 devstack cinder-volume[88093]: WARNING cinder.quota [None req-1a71ef78-2c00-4015-ae0a-0ba931cd97d1 tempest-VolumeTypesAccessTest-81959042 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1589709443 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1589709443, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:51:14 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-1a71ef78-2c00-4015-ae0a-0ba931cd97d1 tempest-VolumeTypesAccessTest-81959042 None] Created reservations ['794de438-0732-4be8-b30e-ad85eba4f902', '18888b2c-baaa-46fd-9e95-b424fa5582ca', '5ade5455-0f82-4f9e-9a8d-eda71f811f18', 'bfb8c4fe-dea4-40f9-bc1e-61c70b59bdf7'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:51:14 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fab8ca48-b8df-439f-8a0d-d97bf863676b tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.416s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:14 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-fab8ca48-b8df-439f-8a0d-d97bf863676b tempest-GroupSnapshotsTest-901873335 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:51:14 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-fab8ca48-b8df-439f-8a0d-d97bf863676b tempest-GroupSnapshotsTest-901873335 None] Delete group completed successfully. Sep 10 19:51:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1a71ef78-2c00-4015-ae0a-0ba931cd97d1 tempest-VolumeTypesAccessTest-81959042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1a71ef78-2c00-4015-ae0a-0ba931cd97d1 tempest-VolumeTypesAccessTest-81959042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1a71ef78-2c00-4015-ae0a-0ba931cd97d1 tempest-VolumeTypesAccessTest-81959042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:51:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1a71ef78-2c00-4015-ae0a-0ba931cd97d1 tempest-VolumeTypesAccessTest-81959042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:51:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1a71ef78-2c00-4015-ae0a-0ba931cd97d1 tempest-VolumeTypesAccessTest-81959042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1a71ef78-2c00-4015-ae0a-0ba931cd97d1 tempest-VolumeTypesAccessTest-81959042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:14 devstack sudo[98292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:51:14 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:14 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-01ccf4fd-5485-4f99-8a9f-ba7b263be223 tempest-GroupSnapshotsTest-901873335 None] Group tempest-GroupSnapshotsTest-Group-2093895300: creating Sep 10 19:51:14 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-01ccf4fd-5485-4f99-8a9f-ba7b263be223 tempest-GroupSnapshotsTest-901873335 None] Group tempest-GroupSnapshotsTest-Group-2093895300: created successfully Sep 10 19:51:14 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-01ccf4fd-5485-4f99-8a9f-ba7b263be223 tempest-GroupSnapshotsTest-901873335 None] Create group completed successfully. Sep 10 19:51:14 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1a71ef78-2c00-4015-ae0a-0ba931cd97d1 tempest-VolumeTypesAccessTest-81959042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.276s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:14 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-1a71ef78-2c00-4015-ae0a-0ba931cd97d1 tempest-VolumeTypesAccessTest-81959042 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:51:14 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-1a71ef78-2c00-4015-ae0a-0ba931cd97d1 tempest-VolumeTypesAccessTest-81959042 None] Deleted volume successfully. Sep 10 19:51:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1a71ef78-2c00-4015-ae0a-0ba931cd97d1 tempest-VolumeTypesAccessTest-81959042 None] Lock "cinder-873c2693-d08d-40a9-8838-198a7fe0d7cd-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:51:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1f5efcb7-aa40-4ff0-8503-fd1d9b791e36 tempest-TestStampPattern-66311909 None] Acquiring lock "cinder-c954c5f1-195a-455d-95ba-f237c1f45781-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:51:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1f5efcb7-aa40-4ff0-8503-fd1d9b791e36 tempest-TestStampPattern-66311909 None] Lock "cinder-c954c5f1-195a-455d-95ba-f237c1f45781-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:51:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1f5efcb7-aa40-4ff0-8503-fd1d9b791e36 tempest-TestStampPattern-66311909 None] Acquiring lock "cinder-quobyte-c954c5f1-195a-455d-95ba-f237c1f45781" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:51:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1f5efcb7-aa40-4ff0-8503-fd1d9b791e36 tempest-TestStampPattern-66311909 None] Lock "cinder-quobyte-c954c5f1-195a-455d-95ba-f237c1f45781" acquired by "delete_volume" :: waited 0.016s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:51:15 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e12a06b-d6a1-4848-ac61-fbcdb474159a]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:51:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1f5efcb7-aa40-4ff0-8503-fd1d9b791e36 tempest-TestStampPattern-66311909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:15 devstack sudo[98295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781 Sep 10 19:51:15 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:15 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1f5efcb7-aa40-4ff0-8503-fd1d9b791e36 tempest-TestStampPattern-66311909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781" returned: 0 in 0.358s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1f5efcb7-aa40-4ff0-8503-fd1d9b791e36 tempest-TestStampPattern-66311909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:15 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781 Sep 10 19:51:15 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:15 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1f5efcb7-aa40-4ff0-8503-fd1d9b791e36 tempest-TestStampPattern-66311909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c954c5f1-195a-455d-95ba-f237c1f45781" returned: 0 in 0.262s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1f5efcb7-aa40-4ff0-8503-fd1d9b791e36 tempest-TestStampPattern-66311909 None] Lock "cinder-quobyte-c954c5f1-195a-455d-95ba-f237c1f45781" released by "delete_volume" :: held 0.683s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:51:15 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-1f5efcb7-aa40-4ff0-8503-fd1d9b791e36 tempest-TestStampPattern-66311909 None] Created reservations ['1678191d-ed1d-490c-bf2a-4d976a691030', '741f4958-6665-4365-984f-d5da3f500337', '904a94dd-384f-4118-a2d3-bc8153e83b61', 'd97d878a-1d61-45ba-8085-e8a57242d4d9'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:51:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1f5efcb7-aa40-4ff0-8503-fd1d9b791e36 tempest-TestStampPattern-66311909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1f5efcb7-aa40-4ff0-8503-fd1d9b791e36 tempest-TestStampPattern-66311909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:15 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1f5efcb7-aa40-4ff0-8503-fd1d9b791e36 tempest-TestStampPattern-66311909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:51:15 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1f5efcb7-aa40-4ff0-8503-fd1d9b791e36 tempest-TestStampPattern-66311909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:51:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1f5efcb7-aa40-4ff0-8503-fd1d9b791e36 tempest-TestStampPattern-66311909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1f5efcb7-aa40-4ff0-8503-fd1d9b791e36 tempest-TestStampPattern-66311909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:15 devstack sudo[98303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:51:15 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:16 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1f5efcb7-aa40-4ff0-8503-fd1d9b791e36 tempest-TestStampPattern-66311909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.278s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:16 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-1f5efcb7-aa40-4ff0-8503-fd1d9b791e36 tempest-TestStampPattern-66311909 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:51:16 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-1f5efcb7-aa40-4ff0-8503-fd1d9b791e36 tempest-TestStampPattern-66311909 None] Deleted volume successfully. Sep 10 19:51:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1f5efcb7-aa40-4ff0-8503-fd1d9b791e36 tempest-TestStampPattern-66311909 None] Lock "cinder-c954c5f1-195a-455d-95ba-f237c1f45781-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:51:16 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:51:16 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] Flow 'volume_create_manager' (02533e0e-8264-4152-9c99-128f51754d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:51:16 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78d84e20-c220-4c41-ad16-3c13194a9ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:16 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78d84e20-c220-4c41-ad16-3c13194a9ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-730447604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4659bdec-ebe2-41b8-b951-6a4d1a523559,host='devstack@QuobyteHD#QuobyteHD',id=a410cdeb-47fe-4664-a32a-df395e3752c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47c1cf4d1734498bd0938a6b8580103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:51:16Z,use_quota=True,user_id='d87a09c27876429f852ac9e937f4358f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e72ba106-093a-4a7e-956b-d7a9c1a85878),volume_type_id=e72ba106-093a-4a7e-956b-d7a9c1a85878)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:16 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de492a26-43df-4ffc-b700-14abc8d64c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:16 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de492a26-43df-4ffc-b700-14abc8d64c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:16 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cdbfac5-e9fb-4353-97fe-bf7854df1129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:16 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cdbfac5-e9fb-4353-97fe-bf7854df1129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a410cdeb-47fe-4664-a32a-df395e3752c5', 'volume_name': 'volume-a410cdeb-47fe-4664-a32a-df395e3752c5', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:16 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0741f0a3-9528-4dc7-bf72-ca966f6bd129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:16 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0741f0a3-9528-4dc7-bf72-ca966f6bd129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:16 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (733f365b-d971-4253-b02c-55a947b512b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:16 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] Volume a410cdeb-47fe-4664-a32a-df395e3752c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a410cdeb-47fe-4664-a32a-df395e3752c5', 'volume_size': 1} Sep 10 19:51:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:16 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4659bdec-ebe2-41b8-b951-6a4d1a523559,created_at=2026-09-10T17:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-730447604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4659bdec-ebe2-41b8-b951-6a4d1a523559,host='devstack@QuobyteHD#QuobyteHD',id=a410cdeb-47fe-4664-a32a-df395e3752c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47c1cf4d1734498bd0938a6b8580103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:51:16Z,use_quota=True,user_id='d87a09c27876429f852ac9e937f4358f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e72ba106-093a-4a7e-956b-d7a9c1a85878),volume_type_id=e72ba106-093a-4a7e-956b-d7a9c1a85878)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:51:16 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] Creating volume a410cdeb-47fe-4664-a32a-df395e3752c5 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:51:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:16 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:51:16 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:51:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:16 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:51:16 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:51:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:16 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5 1073741824 Sep 10 19:51:16 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:17 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5 1073741824" returned: 0 in 0.674s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:17 devstack sudo[98312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5 Sep 10 19:51:17 devstack sudo[98312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:17 devstack sudo[98312]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5" returned: 0 in 0.298s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:17 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:51:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:17 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (733f365b-d971-4253-b02c-55a947b512b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a410cdeb-47fe-4664-a32a-df395e3752c5', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:17 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c0397f3-dd39-4ed9-9905-62f26709c236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:17 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] Volume volume-a410cdeb-47fe-4664-a32a-df395e3752c5 (a410cdeb-47fe-4664-a32a-df395e3752c5): created successfully Sep 10 19:51:17 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c0397f3-dd39-4ed9-9905-62f26709c236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:17 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] Flow 'volume_create_manager' (02533e0e-8264-4152-9c99-128f51754d16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:51:17 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-0772940c-3ca6-43af-87b9-6793de67afba tempest-GroupSnapshotsTest-901873335 None] Created volume successfully. Sep 10 19:51:19 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-f818e051-d21c-4a9b-b71e-d664b4363df4 tempest-GroupSnapshotsTest-901873335 None] GroupSnapshot 8ba2c035-e0fa-4b3b-b9a0-2b8115b8639f: creating. Sep 10 19:51:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f818e051-d21c-4a9b-b71e-d664b4363df4 tempest-GroupSnapshotsTest-901873335 None] Group snapshot 8ba2c035-e0fa-4b3b-b9a0-2b8115b8639f: creating. {{(pid=88093) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 10 19:51:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f818e051-d21c-4a9b-b71e-d664b4363df4 tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f818e051-d21c-4a9b-b71e-d664b4363df4 tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:19 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-f818e051-d21c-4a9b-b71e-d664b4363df4 tempest-GroupSnapshotsTest-901873335 None] Creating offline snapshot 7f6b7029-2f73-407c-b4e5-1d7e83e67837 of volume a410cdeb-47fe-4664-a32a-df395e3752c5 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 19:51:19 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[417761c5-fce6-4846-8035-6bc680fba976]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:51:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f818e051-d21c-4a9b-b71e-d664b4363df4 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:19 devstack sudo[98318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5 Sep 10 19:51:19 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:19 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f818e051-d21c-4a9b-b71e-d664b4363df4 tempest-GroupSnapshotsTest-901873335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5" returned: 0 in 0.439s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f818e051-d21c-4a9b-b71e-d664b4363df4 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5.7f6b7029-2f73-407c-b4e5-1d7e83e67837 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:19 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5.7f6b7029-2f73-407c-b4e5-1d7e83e67837 1G Sep 10 19:51:19 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:20 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f818e051-d21c-4a9b-b71e-d664b4363df4 tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5.7f6b7029-2f73-407c-b4e5-1d7e83e67837 1G" returned: 0 in 0.537s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f818e051-d21c-4a9b-b71e-d664b4363df4 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a410cdeb-47fe-4664-a32a-df395e3752c5 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5.7f6b7029-2f73-407c-b4e5-1d7e83e67837 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:20 devstack sudo[98329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a410cdeb-47fe-4664-a32a-df395e3752c5 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5.7f6b7029-2f73-407c-b4e5-1d7e83e67837 Sep 10 19:51:20 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:20 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f818e051-d21c-4a9b-b71e-d664b4363df4 tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a410cdeb-47fe-4664-a32a-df395e3752c5 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5.7f6b7029-2f73-407c-b4e5-1d7e83e67837" returned: 0 in 0.309s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:20 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-f818e051-d21c-4a9b-b71e-d664b4363df4 tempest-GroupSnapshotsTest-901873335 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5.7f6b7029-2f73-407c-b4e5-1d7e83e67837 is being set with open permissions: ugo+rw: NotImplementedError Sep 10 19:51:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f818e051-d21c-4a9b-b71e-d664b4363df4 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5.7f6b7029-2f73-407c-b4e5-1d7e83e67837 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:20 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5.7f6b7029-2f73-407c-b4e5-1d7e83e67837 Sep 10 19:51:20 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:20 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f818e051-d21c-4a9b-b71e-d664b4363df4 tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5.7f6b7029-2f73-407c-b4e5-1d7e83e67837" returned: 0 in 0.280s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f818e051-d21c-4a9b-b71e-d664b4363df4 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:21 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5.info Sep 10 19:51:21 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:21 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f818e051-d21c-4a9b-b71e-d664b4363df4 tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5.info" returned: 0 in 0.347s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:21 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-f818e051-d21c-4a9b-b71e-d664b4363df4 tempest-GroupSnapshotsTest-901873335 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5.info is being set with open permissions: ugo+rw: NotImplementedError Sep 10 19:51:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f818e051-d21c-4a9b-b71e-d664b4363df4 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:21 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5.info Sep 10 19:51:21 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:21 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f818e051-d21c-4a9b-b71e-d664b4363df4 tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5.info" returned: 0 in 0.336s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f818e051-d21c-4a9b-b71e-d664b4363df4 tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.368s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:21 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-f818e051-d21c-4a9b-b71e-d664b4363df4 tempest-GroupSnapshotsTest-901873335 None] group_snapshot 8ba2c035-e0fa-4b3b-b9a0-2b8115b8639f: created successfully Sep 10 19:51:21 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:51:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] Flow 'volume_create_manager' (537b54a9-e630-4a75-83f4-73c50217aadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:51:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc02b4db-f32f-48ff-8df8-4bf2a9e41d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc02b4db-f32f-48ff-8df8-4bf2a9e41d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-391366934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96725968-9ff8-4932-bc1f-a7c68cc5dba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11eaed70a274e5598720adb4e49c31f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:51:22Z,use_quota=True,user_id='d2332f5d24e7409584d29951df773f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42bb004e-6cef-46f6-b19a-d6a8fd9f1c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42bb004e-6cef-46f6-b19a-d6a8fd9f1c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7f7aac-7586-414c-9ff4-4df2641dc5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7f7aac-7586-414c-9ff4-4df2641dc5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96725968-9ff8-4932-bc1f-a7c68cc5dba9', 'volume_name': 'volume-96725968-9ff8-4932-bc1f-a7c68cc5dba9', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12289925-2b61-49b7-aa27-38243bf0e0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12289925-2b61-49b7-aa27-38243bf0e0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b701dfff-12bd-460f-b3fb-47ee61124139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:22 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] Volume 96725968-9ff8-4932-bc1f-a7c68cc5dba9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96725968-9ff8-4932-bc1f-a7c68cc5dba9', 'volume_size': 1} Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-391366934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96725968-9ff8-4932-bc1f-a7c68cc5dba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11eaed70a274e5598720adb4e49c31f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:51:22Z,use_quota=True,user_id='d2332f5d24e7409584d29951df773f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] Creating volume 96725968-9ff8-4932-bc1f-a7c68cc5dba9 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:51:22 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-96725968-9ff8-4932-bc1f-a7c68cc5dba9 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:22 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-96725968-9ff8-4932-bc1f-a7c68cc5dba9 1073741824 Sep 10 19:51:22 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:22 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-96725968-9ff8-4932-bc1f-a7c68cc5dba9 1073741824" returned: 0 in 0.536s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-96725968-9ff8-4932-bc1f-a7c68cc5dba9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:22 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-96725968-9ff8-4932-bc1f-a7c68cc5dba9 Sep 10 19:51:22 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:22 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-9084d5f6-031d-4db2-bf24-3a4d6955efde tempest-GroupSnapshotsTest-901873335 None] group_snapshot 8ba2c035-e0fa-4b3b-b9a0-2b8115b8639f: deleting Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9084d5f6-031d-4db2-bf24-3a4d6955efde tempest-GroupSnapshotsTest-901873335 None] group_snapshot 8ba2c035-e0fa-4b3b-b9a0-2b8115b8639f: deleting {{(pid=88093) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9084d5f6-031d-4db2-bf24-3a4d6955efde tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "cinder-quobyte-a410cdeb-47fe-4664-a32a-df395e3752c5" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9084d5f6-031d-4db2-bf24-3a4d6955efde tempest-GroupSnapshotsTest-901873335 None] Lock "cinder-quobyte-a410cdeb-47fe-4664-a32a-df395e3752c5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9084d5f6-031d-4db2-bf24-3a4d6955efde tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "cinder-quobyte-7f6b7029-2f73-407c-b4e5-1d7e83e67837" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9084d5f6-031d-4db2-bf24-3a4d6955efde tempest-GroupSnapshotsTest-901873335 None] Lock "cinder-quobyte-7f6b7029-2f73-407c-b4e5-1d7e83e67837" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-9084d5f6-031d-4db2-bf24-3a4d6955efde tempest-GroupSnapshotsTest-901873335 None] Deleting offline snapshot 7f6b7029-2f73-407c-b4e5-1d7e83e67837 of volume a410cdeb-47fe-4664-a32a-df395e3752c5 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-9084d5f6-031d-4db2-bf24-3a4d6955efde tempest-GroupSnapshotsTest-901873335 None] snapshot_file for this snap is: volume-a410cdeb-47fe-4664-a32a-df395e3752c5.7f6b7029-2f73-407c-b4e5-1d7e83e67837 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b9ab78-a693-471e-ba87-b8bab43e8cb3]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9084d5f6-031d-4db2-bf24-3a4d6955efde tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5.7f6b7029-2f73-407c-b4e5-1d7e83e67837 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:22 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-96725968-9ff8-4932-bc1f-a7c68cc5dba9" returned: 0 in 0.359s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:51:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:23 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b701dfff-12bd-460f-b3fb-47ee61124139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96725968-9ff8-4932-bc1f-a7c68cc5dba9', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:23 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66d8545f-2058-4449-b371-36b492117921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:23 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] Volume volume-96725968-9ff8-4932-bc1f-a7c68cc5dba9 (96725968-9ff8-4932-bc1f-a7c68cc5dba9): created successfully Sep 10 19:51:23 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66d8545f-2058-4449-b371-36b492117921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:23 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] Flow 'volume_create_manager' (537b54a9-e630-4a75-83f4-73c50217aadc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:51:23 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-db7750b5-1942-418a-b7a0-a00b0a2be9f8 tempest-AttachVolumeTestJSON-633113798 None] Created volume successfully. Sep 10 19:51:23 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5.7f6b7029-2f73-407c-b4e5-1d7e83e67837 Sep 10 19:51:23 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:23 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9084d5f6-031d-4db2-bf24-3a4d6955efde tempest-GroupSnapshotsTest-901873335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5.7f6b7029-2f73-407c-b4e5-1d7e83e67837" returned: 0 in 0.461s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:23 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-9084d5f6-031d-4db2-bf24-3a4d6955efde tempest-GroupSnapshotsTest-901873335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a410cdeb-47fe-4664-a32a-df395e3752c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:51:23 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f4e26c-386f-49ff-a83c-afc51e535e7f]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:51:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9084d5f6-031d-4db2-bf24-3a4d6955efde tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:23 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5 Sep 10 19:51:23 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:23 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9084d5f6-031d-4db2-bf24-3a4d6955efde tempest-GroupSnapshotsTest-901873335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5" returned: 0 in 0.411s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9084d5f6-031d-4db2-bf24-3a4d6955efde tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5.7f6b7029-2f73-407c-b4e5-1d7e83e67837 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:23 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5.7f6b7029-2f73-407c-b4e5-1d7e83e67837 Sep 10 19:51:23 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:24 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9084d5f6-031d-4db2-bf24-3a4d6955efde tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5.7f6b7029-2f73-407c-b4e5-1d7e83e67837" returned: 0 in 0.404s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9084d5f6-031d-4db2-bf24-3a4d6955efde tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5.7f6b7029-2f73-407c-b4e5-1d7e83e67837 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:24 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5.7f6b7029-2f73-407c-b4e5-1d7e83e67837 Sep 10 19:51:24 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:24 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9084d5f6-031d-4db2-bf24-3a4d6955efde tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5.7f6b7029-2f73-407c-b4e5-1d7e83e67837" returned: 0 in 0.330s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:24 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9084d5f6-031d-4db2-bf24-3a4d6955efde tempest-GroupSnapshotsTest-901873335 None] Lock "cinder-quobyte-7f6b7029-2f73-407c-b4e5-1d7e83e67837" released by "_delete_snapshot" :: held 1.741s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:51:24 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9084d5f6-031d-4db2-bf24-3a4d6955efde tempest-GroupSnapshotsTest-901873335 None] Lock "cinder-quobyte-a410cdeb-47fe-4664-a32a-df395e3752c5" released by "delete_snapshot" :: held 1.776s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:51:24 devstack cinder-volume[88093]: WARNING cinder.quota [None req-9084d5f6-031d-4db2-bf24-3a4d6955efde tempest-GroupSnapshotsTest-901873335 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-87842796 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-87842796, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:51:24 devstack cinder-volume[88093]: WARNING cinder.quota [None req-9084d5f6-031d-4db2-bf24-3a4d6955efde tempest-GroupSnapshotsTest-901873335 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-87842796 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-87842796, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:51:24 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-9084d5f6-031d-4db2-bf24-3a4d6955efde tempest-GroupSnapshotsTest-901873335 None] Created reservations ['5531485b-24a0-4ab3-bf96-e474afb4bfb1', 'a5f9635d-cff8-4360-b296-f1b10ad5f731', 'ef055069-db45-4046-bfbd-4f43f8b30cf0', '51bd7ef7-8d61-4578-8e93-8c55288c5a72'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:51:24 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-9084d5f6-031d-4db2-bf24-3a4d6955efde tempest-GroupSnapshotsTest-901873335 None] group_snapshot 8ba2c035-e0fa-4b3b-b9a0-2b8115b8639f: deleted successfully Sep 10 19:51:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-f61b8b6e-40e3-4abf-a2b2-f3181e54905b req-6ba13e92-1bc2-4841-a647-1cb148119326 tempest-AttachVolumeTestJSON-633113798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-f61b8b6e-40e3-4abf-a2b2-f3181e54905b req-6ba13e92-1bc2-4841-a647-1cb148119326 tempest-AttachVolumeTestJSON-633113798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-f61b8b6e-40e3-4abf-a2b2-f3181e54905b req-6ba13e92-1bc2-4841-a647-1cb148119326 tempest-AttachVolumeTestJSON-633113798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-f61b8b6e-40e3-4abf-a2b2-f3181e54905b req-6ba13e92-1bc2-4841-a647-1cb148119326 tempest-AttachVolumeTestJSON-633113798 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3', 'name': 'volume-96725968-9ff8-4932-bc1f-a7c68cc5dba9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9357e300-2051-4584-826c-0f30d38d274a', 'enforce_multipath': True} {{(pid=88093) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 19:51:25 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-f61b8b6e-40e3-4abf-a2b2-f3181e54905b req-6ba13e92-1bc2-4841-a647-1cb148119326 tempest-AttachVolumeTestJSON-633113798 None] attachment_update completed successfully. Sep 10 19:51:25 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1ce2cff4-76d2-4d8d-850e-35ec5efd4b94 tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "cinder-quobyte-a410cdeb-47fe-4664-a32a-df395e3752c5" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:51:25 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1ce2cff4-76d2-4d8d-850e-35ec5efd4b94 tempest-GroupSnapshotsTest-901873335 None] Lock "cinder-quobyte-a410cdeb-47fe-4664-a32a-df395e3752c5" acquired by "delete_volume" :: waited 0.021s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:51:25 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc2045a-7d12-45fa-8838-2643f8e05e12]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:51:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1ce2cff4-76d2-4d8d-850e-35ec5efd4b94 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:26 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5 Sep 10 19:51:26 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:26 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1ce2cff4-76d2-4d8d-850e-35ec5efd4b94 tempest-GroupSnapshotsTest-901873335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5" returned: 0 in 0.468s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1ce2cff4-76d2-4d8d-850e-35ec5efd4b94 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:26 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5 Sep 10 19:51:26 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:26 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1ce2cff4-76d2-4d8d-850e-35ec5efd4b94 tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a410cdeb-47fe-4664-a32a-df395e3752c5" returned: 0 in 0.248s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:26 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1ce2cff4-76d2-4d8d-850e-35ec5efd4b94 tempest-GroupSnapshotsTest-901873335 None] Lock "cinder-quobyte-a410cdeb-47fe-4664-a32a-df395e3752c5" released by "delete_volume" :: held 0.921s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:51:26 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-1ce2cff4-76d2-4d8d-850e-35ec5efd4b94 tempest-GroupSnapshotsTest-901873335 None] Created reservations ['67e395b2-a68e-4901-88b5-7ad9f4f23502'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:51:26 devstack cinder-volume[88093]: WARNING cinder.quota [None req-1ce2cff4-76d2-4d8d-850e-35ec5efd4b94 tempest-GroupSnapshotsTest-901873335 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-87842796 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-87842796, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:51:26 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-1ce2cff4-76d2-4d8d-850e-35ec5efd4b94 tempest-GroupSnapshotsTest-901873335 None] Created reservations ['a15776d2-17b5-4042-85b6-2a2676e2b232', '2352205f-c7aa-48f6-a751-f65c12cd5b90', '7fe83747-1f1b-4f67-895d-874388005e09', '62cea911-9ed3-4277-b454-cdd4ea27bbea'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:51:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1ce2cff4-76d2-4d8d-850e-35ec5efd4b94 tempest-GroupSnapshotsTest-901873335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1ce2cff4-76d2-4d8d-850e-35ec5efd4b94 tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:27 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1ce2cff4-76d2-4d8d-850e-35ec5efd4b94 tempest-GroupSnapshotsTest-901873335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:51:27 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1ce2cff4-76d2-4d8d-850e-35ec5efd4b94 tempest-GroupSnapshotsTest-901873335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:51:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1ce2cff4-76d2-4d8d-850e-35ec5efd4b94 tempest-GroupSnapshotsTest-901873335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.063s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1ce2cff4-76d2-4d8d-850e-35ec5efd4b94 tempest-GroupSnapshotsTest-901873335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:27 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:51:27 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:27 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1ce2cff4-76d2-4d8d-850e-35ec5efd4b94 tempest-GroupSnapshotsTest-901873335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.352s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:27 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-1ce2cff4-76d2-4d8d-850e-35ec5efd4b94 tempest-GroupSnapshotsTest-901873335 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:51:27 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-1ce2cff4-76d2-4d8d-850e-35ec5efd4b94 tempest-GroupSnapshotsTest-901873335 None] Delete group completed successfully. Sep 10 19:51:28 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:51:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] Flow 'volume_create_manager' (ddcf3681-845a-4913-9cc9-b8df5485e878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:51:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f682e51b-0965-4053-84b0-e19797561c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f682e51b-0965-4053-84b0-e19797561c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2074734871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d43c84cd-db78-4eb1-a549-ca85d098e2cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11eaed70a274e5598720adb4e49c31f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:51:28Z,use_quota=True,user_id='d2332f5d24e7409584d29951df773f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (531a55b8-d758-4e48-b854-e4e9b9b01e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (531a55b8-d758-4e48-b854-e4e9b9b01e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1d895e-83e2-4f8f-9c73-31ef1ca656ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1d895e-83e2-4f8f-9c73-31ef1ca656ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd43c84cd-db78-4eb1-a549-ca85d098e2cd', 'volume_name': 'volume-d43c84cd-db78-4eb1-a549-ca85d098e2cd', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01874e74-150f-462f-8657-1f8cda36704e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01874e74-150f-462f-8657-1f8cda36704e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99e4e06f-18c4-4caa-aad0-24cf64c2fc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:28 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] Volume d43c84cd-db78-4eb1-a549-ca85d098e2cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d43c84cd-db78-4eb1-a549-ca85d098e2cd', 'volume_size': 1} Sep 10 19:51:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2074734871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d43c84cd-db78-4eb1-a549-ca85d098e2cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11eaed70a274e5598720adb4e49c31f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:51:28Z,use_quota=True,user_id='d2332f5d24e7409584d29951df773f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:51:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] Creating volume d43c84cd-db78-4eb1-a549-ca85d098e2cd {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:51:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:51:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:51:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:51:28 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:51:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d43c84cd-db78-4eb1-a549-ca85d098e2cd 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:28 devstack sudo[98818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d43c84cd-db78-4eb1-a549-ca85d098e2cd 1073741824 Sep 10 19:51:28 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:29 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d43c84cd-db78-4eb1-a549-ca85d098e2cd 1073741824" returned: 0 in 0.709s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:29 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=156,cinder:INSERT=35,cinder:UPDATE=140,cinder:DELETE=4 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:51:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d43c84cd-db78-4eb1-a549-ca85d098e2cd {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:29 devstack sudo[98826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d43c84cd-db78-4eb1-a549-ca85d098e2cd Sep 10 19:51:29 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:29 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d43c84cd-db78-4eb1-a549-ca85d098e2cd" returned: 0 in 0.314s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:29 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:51:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99e4e06f-18c4-4caa-aad0-24cf64c2fc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d43c84cd-db78-4eb1-a549-ca85d098e2cd', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c8ab4a-66fe-44e5-9642-5b6266fe53f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:29 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] Volume volume-d43c84cd-db78-4eb1-a549-ca85d098e2cd (d43c84cd-db78-4eb1-a549-ca85d098e2cd): created successfully Sep 10 19:51:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c8ab4a-66fe-44e5-9642-5b6266fe53f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] Flow 'volume_create_manager' (ddcf3681-845a-4913-9cc9-b8df5485e878) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:51:29 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-256c1104-a6cb-44bd-9982-acbc93b56241 tempest-AttachVolumeTestJSON-633113798 None] Created volume successfully. Sep 10 19:51:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-99448c5c-cba4-48ae-a9a2-885e98cb213a req-b7ab2ebf-c1a3-494b-8d99-985ae76a315f tempest-AttachVolumeTestJSON-633113798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-99448c5c-cba4-48ae-a9a2-885e98cb213a req-b7ab2ebf-c1a3-494b-8d99-985ae76a315f tempest-AttachVolumeTestJSON-633113798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-99448c5c-cba4-48ae-a9a2-885e98cb213a req-b7ab2ebf-c1a3-494b-8d99-985ae76a315f tempest-AttachVolumeTestJSON-633113798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-99448c5c-cba4-48ae-a9a2-885e98cb213a req-b7ab2ebf-c1a3-494b-8d99-985ae76a315f tempest-AttachVolumeTestJSON-633113798 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3', 'name': 'volume-d43c84cd-db78-4eb1-a549-ca85d098e2cd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f6ea49b5-65fe-4da4-8480-d0bbcfb52df3', 'enforce_multipath': True} {{(pid=88093) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 19:51:31 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-99448c5c-cba4-48ae-a9a2-885e98cb213a req-b7ab2ebf-c1a3-494b-8d99-985ae76a315f tempest-AttachVolumeTestJSON-633113798 None] attachment_update completed successfully. Sep 10 19:51:33 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-7c006e84-5f86-41f3-8cf8-dfd03e54279f req-93505690-ce2e-44ec-a873-acad0ae99080 tempest-AttachVolumeTestJSON-633113798 None] Terminate volume connection completed successfully. Sep 10 19:51:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-7c006e84-5f86-41f3-8cf8-dfd03e54279f req-93505690-ce2e-44ec-a873-acad0ae99080 tempest-AttachVolumeTestJSON-633113798 None] Deleting attachment 9357e300-2051-4584-826c-0f30d38d274a. {{(pid=88093) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 19:51:34 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-00269aca-1b4c-4c14-8040-69571b0f2980 req-b8203003-ecea-4039-82af-1b861050f381 tempest-AttachVolumeTestJSON-633113798 None] Terminate volume connection completed successfully. Sep 10 19:51:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-00269aca-1b4c-4c14-8040-69571b0f2980 req-b8203003-ecea-4039-82af-1b861050f381 tempest-AttachVolumeTestJSON-633113798 None] Deleting attachment f6ea49b5-65fe-4da4-8480-d0bbcfb52df3. {{(pid=88093) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 19:51:40 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:51:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Flow 'volume_create_manager' (34a760a2-b939-4467-a296-e51dd58c182a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:51:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4382047f-31aa-45c1-aae4-17d1a7f0e65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4382047f-31aa-45c1-aae4-17d1a7f0e65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23399bbd-808f-40c2-a847-aab554bc3359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1144d3fdde4b369cc2ce4bd2979f99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:51:40Z,use_quota=True,user_id='3079e7a2058747f4969ff17f88e472c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c4105cba-2a15-41a1-8c1c-8a6e008006f8),volume_type_id=c4105cba-2a15-41a1-8c1c-8a6e008006f8)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca709454-e781-4c2d-9420-cf6ccf22cfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca709454-e781-4c2d-9420-cf6ccf22cfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea761a2-ff66-4312-a9e8-a454ad8edd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:40 devstack cinder-volume[88093]: DEBUG cinder.image.glance [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Creating Keystone auth plugin from conf {{(pid=88093) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 19:51:40 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-98fd1a93-51e6-475f-8a66-ce3b3f922fb7 tempest-AttachVolumeTestJSON-633113798 None] Acquiring lock "cinder-d43c84cd-db78-4eb1-a549-ca85d098e2cd-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:51:40 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-98fd1a93-51e6-475f-8a66-ce3b3f922fb7 tempest-AttachVolumeTestJSON-633113798 None] Lock "cinder-d43c84cd-db78-4eb1-a549-ca85d098e2cd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:51:40 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-98fd1a93-51e6-475f-8a66-ce3b3f922fb7 tempest-AttachVolumeTestJSON-633113798 None] Acquiring lock "cinder-quobyte-d43c84cd-db78-4eb1-a549-ca85d098e2cd" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:51:40 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-98fd1a93-51e6-475f-8a66-ce3b3f922fb7 tempest-AttachVolumeTestJSON-633113798 None] Lock "cinder-quobyte-d43c84cd-db78-4eb1-a549-ca85d098e2cd" acquired by "delete_volume" :: waited 0.026s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:51:40 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a337d4-4462-413e-a729-803aaf20a620]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:51:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-98fd1a93-51e6-475f-8a66-ce3b3f922fb7 tempest-AttachVolumeTestJSON-633113798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d43c84cd-db78-4eb1-a549-ca85d098e2cd {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:41 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d43c84cd-db78-4eb1-a549-ca85d098e2cd Sep 10 19:51:41 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea761a2-ff66-4312-a9e8-a454ad8edd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '23399bbd-808f-40c2-a847-aab554bc3359', 'volume_name': 'volume-23399bbd-808f-40c2-a847-aab554bc3359', 'volume_size': 1, 'image_id': 'c9b5e93f-a962-4c73-9cac-6ce287569acd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c9b5e93f-a962-4c73-9cac-6ce287569acd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a763c5a5565dab513b246624d965c5dd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dd1144d3fdde4b369cc2ce4bd2979f99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b2ea8561f279b13e882f2d8a16c81c96e04859a0507934ff9d551f96536d87bb67fce94702e608fd7a03255df5821287ded9c005c33efb6ebc701e270a548477', 'id': 'c9b5e93f-a962-4c73-9cac-6ce287569acd', 'created_at': datetime.datetime(2026, 9, 10, 17, 51, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 51, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9b5e93f-a962-4c73-9cac-6ce287569acd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19685768-711d-4dc0-814b-cedf7e3320d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19685768-711d-4dc0-814b-cedf7e3320d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8671a1d-5e95-4a18-aee4-f78522c55346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:41 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Volume 23399bbd-808f-40c2-a847-aab554bc3359: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-23399bbd-808f-40c2-a847-aab554bc3359', 'volume_size': 1, 'image_id': 'c9b5e93f-a962-4c73-9cac-6ce287569acd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c9b5e93f-a962-4c73-9cac-6ce287569acd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a763c5a5565dab513b246624d965c5dd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dd1144d3fdde4b369cc2ce4bd2979f99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b2ea8561f279b13e882f2d8a16c81c96e04859a0507934ff9d551f96536d87bb67fce94702e608fd7a03255df5821287ded9c005c33efb6ebc701e270a548477', 'id': 'c9b5e93f-a962-4c73-9cac-6ce287569acd', 'created_at': datetime.datetime(2026, 9, 10, 17, 51, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 51, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9b5e93f-a962-4c73-9cac-6ce287569acd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 10 19:51:41 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Trying to clone 23399bbd-808f-40c2-a847-aab554bc3359 from image c9b5e93f-a962-4c73-9cac-6ce287569acd at location (None, [{'url': 'file:///opt/stack/data/glance/images/c9b5e93f-a962-4c73-9cac-6ce287569acd', 'metadata': {}}]). {{(pid=88093) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 19:51:41 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-98fd1a93-51e6-475f-8a66-ce3b3f922fb7 tempest-AttachVolumeTestJSON-633113798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d43c84cd-db78-4eb1-a549-ca85d098e2cd" returned: 0 in 0.448s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-98fd1a93-51e6-475f-8a66-ce3b3f922fb7 tempest-AttachVolumeTestJSON-633113798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d43c84cd-db78-4eb1-a549-ca85d098e2cd {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:41 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d43c84cd-db78-4eb1-a549-ca85d098e2cd Sep 10 19:51:41 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:41 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c9b5e93f-a962-4c73-9cac-6ce287569acd_vi_cn3dodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88093) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 19:51:41 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Image download 0.00 MB at 0.00 MB/s Sep 10 19:51:41 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[160522a8-721b-43ab-a153-0c624fb4751f]: (4, 'raw') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:51:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9b5e93f-a962-4c73-9cac-6ce287569acd_vi_cn3dodevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:41 devstack sudo[98905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9b5e93f-a962-4c73-9cac-6ce287569acd_vi_cn3dodevstack@QuobyteHD Sep 10 19:51:41 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:41 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-98fd1a93-51e6-475f-8a66-ce3b3f922fb7 tempest-AttachVolumeTestJSON-633113798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d43c84cd-db78-4eb1-a549-ca85d098e2cd" returned: 0 in 0.338s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:41 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-98fd1a93-51e6-475f-8a66-ce3b3f922fb7 tempest-AttachVolumeTestJSON-633113798 None] Lock "cinder-quobyte-d43c84cd-db78-4eb1-a549-ca85d098e2cd" released by "delete_volume" :: held 0.857s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:51:41 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-98fd1a93-51e6-475f-8a66-ce3b3f922fb7 tempest-AttachVolumeTestJSON-633113798 None] Created reservations ['8a29bba4-667d-47fc-95a3-7f1501d1f98e', '744314c1-0efc-47e9-b2a3-460c51bade84', '0b6b8134-b1a4-4eea-90dd-1bc02a59123d', '646e6e86-8f77-4ae4-aa6b-ffb4dfd382ad'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:51:41 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9b5e93f-a962-4c73-9cac-6ce287569acd_vi_cn3dodevstack@QuobyteHD" returned: 0 in 0.502s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9b5e93f-a962-4c73-9cac-6ce287569acd_vi_cn3dodevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-98fd1a93-51e6-475f-8a66-ce3b3f922fb7 tempest-AttachVolumeTestJSON-633113798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-98fd1a93-51e6-475f-8a66-ce3b3f922fb7 tempest-AttachVolumeTestJSON-633113798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:42 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-98fd1a93-51e6-475f-8a66-ce3b3f922fb7 tempest-AttachVolumeTestJSON-633113798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:51:42 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-98fd1a93-51e6-475f-8a66-ce3b3f922fb7 tempest-AttachVolumeTestJSON-633113798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:51:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-98fd1a93-51e6-475f-8a66-ce3b3f922fb7 tempest-AttachVolumeTestJSON-633113798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-98fd1a93-51e6-475f-8a66-ce3b3f922fb7 tempest-AttachVolumeTestJSON-633113798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:42 devstack sudo[98911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:51:42 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:42 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9b5e93f-a962-4c73-9cac-6ce287569acd_vi_cn3dodevstack@QuobyteHD Sep 10 19:51:42 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:42 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-98fd1a93-51e6-475f-8a66-ce3b3f922fb7 tempest-AttachVolumeTestJSON-633113798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.320s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:42 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-98fd1a93-51e6-475f-8a66-ce3b3f922fb7 tempest-AttachVolumeTestJSON-633113798 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:51:42 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-98fd1a93-51e6-475f-8a66-ce3b3f922fb7 tempest-AttachVolumeTestJSON-633113798 None] Deleted volume successfully. Sep 10 19:51:42 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-98fd1a93-51e6-475f-8a66-ce3b3f922fb7 tempest-AttachVolumeTestJSON-633113798 None] Lock "cinder-d43c84cd-db78-4eb1-a549-ca85d098e2cd-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:51:42 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9b5e93f-a962-4c73-9cac-6ce287569acd_vi_cn3dodevstack@QuobyteHD" returned: 1 in 0.444s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9b5e93f-a962-4c73-9cac-6ce287569acd_vi_cn3dodevstack@QuobyteHD' failed. Not Retrying. {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 19:51:42 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Temporary image c9b5e93f-a962-4c73-9cac-6ce287569acd is fetched for user 3079e7a2058747f4969ff17f88e472c3. {{(pid=88093) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 19:51:42 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4b0b95-638d-4e59-a3f8-77aeabd56e06]: (4, 'raw') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:51:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9b5e93f-a962-4c73-9cac-6ce287569acd_vi_cn3dodevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:42 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9b5e93f-a962-4c73-9cac-6ce287569acd_vi_cn3dodevstack@QuobyteHD Sep 10 19:51:42 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:42 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9b5e93f-a962-4c73-9cac-6ce287569acd_vi_cn3dodevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9b5e93f-a962-4c73-9cac-6ce287569acd_vi_cn3dodevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:43 devstack sudo[98922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9b5e93f-a962-4c73-9cac-6ce287569acd_vi_cn3dodevstack@QuobyteHD Sep 10 19:51:43 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-103f1187-82d4-4d9c-b537-fe227f72a991 tempest-AttachVolumeTestJSON-633113798 None] Acquiring lock "cinder-96725968-9ff8-4932-bc1f-a7c68cc5dba9-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:51:43 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9b5e93f-a962-4c73-9cac-6ce287569acd_vi_cn3dodevstack@QuobyteHD" returned: 1 in 0.386s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9b5e93f-a962-4c73-9cac-6ce287569acd_vi_cn3dodevstack@QuobyteHD' failed. Not Retrying. {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 19:51:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23399bbd-808f-40c2-a847-aab554bc3359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1144d3fdde4b369cc2ce4bd2979f99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:51:40Z,use_quota=True,user_id='3079e7a2058747f4969ff17f88e472c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c4105cba-2a15-41a1-8c1c-8a6e008006f8),volume_type_id=c4105cba-2a15-41a1-8c1c-8a6e008006f8)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:51:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Creating volume 23399bbd-808f-40c2-a847-aab554bc3359 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:51:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:51:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:51:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:51:43 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:51:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-23399bbd-808f-40c2-a847-aab554bc3359 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-103f1187-82d4-4d9c-b537-fe227f72a991 tempest-AttachVolumeTestJSON-633113798 None] Lock "cinder-96725968-9ff8-4932-bc1f-a7c68cc5dba9-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:51:43 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-23399bbd-808f-40c2-a847-aab554bc3359 1073741824 Sep 10 19:51:43 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-103f1187-82d4-4d9c-b537-fe227f72a991 tempest-AttachVolumeTestJSON-633113798 None] Acquiring lock "cinder-quobyte-96725968-9ff8-4932-bc1f-a7c68cc5dba9" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:51:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-103f1187-82d4-4d9c-b537-fe227f72a991 tempest-AttachVolumeTestJSON-633113798 None] Lock "cinder-quobyte-96725968-9ff8-4932-bc1f-a7c68cc5dba9" acquired by "delete_volume" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:51:43 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15548d2-7a52-480b-ad14-5797e9172187]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:51:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-103f1187-82d4-4d9c-b537-fe227f72a991 tempest-AttachVolumeTestJSON-633113798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-96725968-9ff8-4932-bc1f-a7c68cc5dba9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:43 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-96725968-9ff8-4932-bc1f-a7c68cc5dba9 Sep 10 19:51:43 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:43 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-23399bbd-808f-40c2-a847-aab554bc3359 1073741824" returned: 0 in 0.615s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:43 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-103f1187-82d4-4d9c-b537-fe227f72a991 tempest-AttachVolumeTestJSON-633113798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-96725968-9ff8-4932-bc1f-a7c68cc5dba9" returned: 0 in 0.497s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-103f1187-82d4-4d9c-b537-fe227f72a991 tempest-AttachVolumeTestJSON-633113798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-96725968-9ff8-4932-bc1f-a7c68cc5dba9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:43 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-96725968-9ff8-4932-bc1f-a7c68cc5dba9 Sep 10 19:51:43 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-23399bbd-808f-40c2-a847-aab554bc3359 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:44 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-23399bbd-808f-40c2-a847-aab554bc3359 Sep 10 19:51:44 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:44 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-103f1187-82d4-4d9c-b537-fe227f72a991 tempest-AttachVolumeTestJSON-633113798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-96725968-9ff8-4932-bc1f-a7c68cc5dba9" returned: 0 in 0.323s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:44 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-103f1187-82d4-4d9c-b537-fe227f72a991 tempest-AttachVolumeTestJSON-633113798 None] Lock "cinder-quobyte-96725968-9ff8-4932-bc1f-a7c68cc5dba9" released by "delete_volume" :: held 0.883s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:51:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-23399bbd-808f-40c2-a847-aab554bc3359" returned: 0 in 0.302s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:44 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:51:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:44 devstack cinder-volume[88093]: DEBUG cinder.volume.volume_utils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Attempting download of c9b5e93f-a962-4c73-9cac-6ce287569acd ((None, [{'url': 'file:///opt/stack/data/glance/images/c9b5e93f-a962-4c73-9cac-6ce287569acd', 'metadata': {}}])) to volume 23399bbd-808f-40c2-a847-aab554bc3359. {{(pid=88093) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 19:51:44 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-103f1187-82d4-4d9c-b537-fe227f72a991 tempest-AttachVolumeTestJSON-633113798 None] Created reservations ['0391156a-aef1-4aa5-a2a5-426b7276d0b1', 'da3c1e54-b851-4b52-a428-3466d8cb3b66', '7501def3-d966-4c7f-8259-69cc4190e16e', '8f451ea3-3876-4632-bda7-b16636c89810'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:51:44 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2dfb117-972a-4a88-afd8-d368d3d6fc4f]: (4, 'raw') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:51:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c9b5e93f-a962-4c73-9cac-6ce287569acd_fs5j8nii {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-103f1187-82d4-4d9c-b537-fe227f72a991 tempest-AttachVolumeTestJSON-633113798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-103f1187-82d4-4d9c-b537-fe227f72a991 tempest-AttachVolumeTestJSON-633113798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:44 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-103f1187-82d4-4d9c-b537-fe227f72a991 tempest-AttachVolumeTestJSON-633113798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:51:44 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-103f1187-82d4-4d9c-b537-fe227f72a991 tempest-AttachVolumeTestJSON-633113798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:51:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-103f1187-82d4-4d9c-b537-fe227f72a991 tempest-AttachVolumeTestJSON-633113798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-103f1187-82d4-4d9c-b537-fe227f72a991 tempest-AttachVolumeTestJSON-633113798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:44 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:51:44 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:44 devstack sudo[98944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c9b5e93f-a962-4c73-9cac-6ce287569acd_fs5j8nii Sep 10 19:51:44 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ca2396e9-ea7b-4ba9-a030-f5a5307b6ec6 tempest-AttachVolumeTestJSON-633113798 None] Acquiring lock "cinder-ca24366a-ae8c-41b2-8af1-dc045d585f58-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:51:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ca2396e9-ea7b-4ba9-a030-f5a5307b6ec6 tempest-AttachVolumeTestJSON-633113798 None] Lock "cinder-ca24366a-ae8c-41b2-8af1-dc045d585f58-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:51:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ca2396e9-ea7b-4ba9-a030-f5a5307b6ec6 tempest-AttachVolumeTestJSON-633113798 None] Acquiring lock "cinder-quobyte-ca24366a-ae8c-41b2-8af1-dc045d585f58" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:51:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ca2396e9-ea7b-4ba9-a030-f5a5307b6ec6 tempest-AttachVolumeTestJSON-633113798 None] Lock "cinder-quobyte-ca24366a-ae8c-41b2-8af1-dc045d585f58" acquired by "delete_volume" :: waited 0.022s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:51:44 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[899862fe-352d-4797-b4d7-b7bab6994bb4]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:51:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ca2396e9-ea7b-4ba9-a030-f5a5307b6ec6 tempest-AttachVolumeTestJSON-633113798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ca24366a-ae8c-41b2-8af1-dc045d585f58 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:44 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-103f1187-82d4-4d9c-b537-fe227f72a991 tempest-AttachVolumeTestJSON-633113798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.474s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:44 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-103f1187-82d4-4d9c-b537-fe227f72a991 tempest-AttachVolumeTestJSON-633113798 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:51:44 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ca24366a-ae8c-41b2-8af1-dc045d585f58 Sep 10 19:51:44 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:44 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-103f1187-82d4-4d9c-b537-fe227f72a991 tempest-AttachVolumeTestJSON-633113798 None] Deleted volume successfully. Sep 10 19:51:44 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-103f1187-82d4-4d9c-b537-fe227f72a991 tempest-AttachVolumeTestJSON-633113798 None] Lock "cinder-96725968-9ff8-4932-bc1f-a7c68cc5dba9-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:51:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c9b5e93f-a962-4c73-9cac-6ce287569acd_fs5j8nii" returned: 0 in 0.583s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9b5e93f-a962-4c73-9cac-6ce287569acd_fs5j8nii {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:45 devstack sudo[98953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9b5e93f-a962-4c73-9cac-6ce287569acd_fs5j8nii Sep 10 19:51:45 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:45 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ca2396e9-ea7b-4ba9-a030-f5a5307b6ec6 tempest-AttachVolumeTestJSON-633113798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ca24366a-ae8c-41b2-8af1-dc045d585f58" returned: 0 in 0.487s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ca2396e9-ea7b-4ba9-a030-f5a5307b6ec6 tempest-AttachVolumeTestJSON-633113798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ca24366a-ae8c-41b2-8af1-dc045d585f58 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:45 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ca24366a-ae8c-41b2-8af1-dc045d585f58 Sep 10 19:51:45 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:45 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9b5e93f-a962-4c73-9cac-6ce287569acd_fs5j8nii" returned: 1 in 0.402s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9b5e93f-a962-4c73-9cac-6ce287569acd_fs5j8nii' failed. Not Retrying. {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 19:51:45 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f969d1-3272-4add-9a02-1baf35185a41]: (4, 'raw') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:51:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9b5e93f-a962-4c73-9cac-6ce287569acd_vi_cn3dodevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:45 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9b5e93f-a962-4c73-9cac-6ce287569acd_vi_cn3dodevstack@QuobyteHD Sep 10 19:51:45 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:45 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ca2396e9-ea7b-4ba9-a030-f5a5307b6ec6 tempest-AttachVolumeTestJSON-633113798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ca24366a-ae8c-41b2-8af1-dc045d585f58" returned: 0 in 0.329s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:45 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ca2396e9-ea7b-4ba9-a030-f5a5307b6ec6 tempest-AttachVolumeTestJSON-633113798 None] Lock "cinder-quobyte-ca24366a-ae8c-41b2-8af1-dc045d585f58" released by "delete_volume" :: held 0.882s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:51:45 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-ca2396e9-ea7b-4ba9-a030-f5a5307b6ec6 tempest-AttachVolumeTestJSON-633113798 None] Created reservations ['d1b06595-4918-47be-952d-2673b1a786b1', 'e1b5607d-e029-44be-b6d0-f46f4e5545c7', '741cee0c-516b-48aa-a0e5-9e7bcdae8276', '13675560-f748-405a-8ca9-4b43cd850a47'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:51:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ca2396e9-ea7b-4ba9-a030-f5a5307b6ec6 tempest-AttachVolumeTestJSON-633113798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ca2396e9-ea7b-4ba9-a030-f5a5307b6ec6 tempest-AttachVolumeTestJSON-633113798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ca2396e9-ea7b-4ba9-a030-f5a5307b6ec6 tempest-AttachVolumeTestJSON-633113798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:51:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ca2396e9-ea7b-4ba9-a030-f5a5307b6ec6 tempest-AttachVolumeTestJSON-633113798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:51:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ca2396e9-ea7b-4ba9-a030-f5a5307b6ec6 tempest-AttachVolumeTestJSON-633113798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ca2396e9-ea7b-4ba9-a030-f5a5307b6ec6 tempest-AttachVolumeTestJSON-633113798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:45 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:51:45 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:45 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9b5e93f-a962-4c73-9cac-6ce287569acd_vi_cn3dodevstack@QuobyteHD" returned: 0 in 0.593s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9b5e93f-a962-4c73-9cac-6ce287569acd_vi_cn3dodevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:46 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9b5e93f-a962-4c73-9cac-6ce287569acd_vi_cn3dodevstack@QuobyteHD Sep 10 19:51:46 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:46 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ca2396e9-ea7b-4ba9-a030-f5a5307b6ec6 tempest-AttachVolumeTestJSON-633113798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.330s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:46 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-ca2396e9-ea7b-4ba9-a030-f5a5307b6ec6 tempest-AttachVolumeTestJSON-633113798 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:51:46 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-ca2396e9-ea7b-4ba9-a030-f5a5307b6ec6 tempest-AttachVolumeTestJSON-633113798 None] Deleted volume successfully. Sep 10 19:51:46 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ca2396e9-ea7b-4ba9-a030-f5a5307b6ec6 tempest-AttachVolumeTestJSON-633113798 None] Lock "cinder-ca24366a-ae8c-41b2-8af1-dc045d585f58-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:51:46 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9b5e93f-a962-4c73-9cac-6ce287569acd_vi_cn3dodevstack@QuobyteHD" returned: 1 in 0.422s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9b5e93f-a962-4c73-9cac-6ce287569acd_vi_cn3dodevstack@QuobyteHD' failed. Not Retrying. {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 19:51:46 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] c9b5e93f-a962-4c73-9cac-6ce287569acd was raw, converting to qcow2 {{(pid=88093) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 19:51:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c9b5e93f-a962-4c73-9cac-6ce287569acd_vi_cn3dodevstack@QuobyteHD /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-23399bbd-808f-40c2-a847-aab554bc3359 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:46 devstack sudo[98977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c9b5e93f-a962-4c73-9cac-6ce287569acd_vi_cn3dodevstack@QuobyteHD /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-23399bbd-808f-40c2-a847-aab554bc3359 Sep 10 19:51:46 devstack sudo[98977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:47 devstack sudo[98977]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c9b5e93f-a962-4c73-9cac-6ce287569acd_vi_cn3dodevstack@QuobyteHD /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-23399bbd-808f-40c2-a847-aab554bc3359" returned: 0 in 0.636s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:47 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c9b5e93f-a962-4c73-9cac-6ce287569acd_vi_cn3dodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-23399bbd-808f-40c2-a847-aab554bc3359 {{(pid=88093) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 19:51:47 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Converted 0.00 MB image at 0.00 MB/s Sep 10 19:51:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-23399bbd-808f-40c2-a847-aab554bc3359 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:47 devstack sudo[98989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-23399bbd-808f-40c2-a847-aab554bc3359 1G Sep 10 19:51:47 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:47 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-23399bbd-808f-40c2-a847-aab554bc3359 1G" returned: 0 in 0.438s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:47 devstack cinder-volume[88093]: DEBUG cinder.volume.volume_utils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Downloaded image c9b5e93f-a962-4c73-9cac-6ce287569acd ((None, [{'url': 'file:///opt/stack/data/glance/images/c9b5e93f-a962-4c73-9cac-6ce287569acd', 'metadata': {}}])) to volume 23399bbd-808f-40c2-a847-aab554bc3359 successfully. {{(pid=88093) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 19:51:47 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Temporary image c9b5e93f-a962-4c73-9cac-6ce287569acd for user 3079e7a2058747f4969ff17f88e472c3 is deleted. {{(pid=88093) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 19:51:47 devstack cinder-volume[88093]: DEBUG cinder.volume.volume_utils [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Marking volume 23399bbd-808f-40c2-a847-aab554bc3359 as bootable. {{(pid=88093) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 19:51:47 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Copying metadata from image c9b5e93f-a962-4c73-9cac-6ce287569acd to 23399bbd-808f-40c2-a847-aab554bc3359. {{(pid=88093) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 19:51:47 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Creating volume glance metadata for volume 23399bbd-808f-40c2-a847-aab554bc3359 backed by image c9b5e93f-a962-4c73-9cac-6ce287569acd with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c9b5e93f-a962-4c73-9cac-6ce287569acd', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a763c5a5565dab513b246624d965c5dd', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88093) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 19:51:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8671a1d-5e95-4a18-aee4-f78522c55346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23399bbd-808f-40c2-a847-aab554bc3359', 'volume_size': 1, 'image_id': 'c9b5e93f-a962-4c73-9cac-6ce287569acd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c9b5e93f-a962-4c73-9cac-6ce287569acd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a763c5a5565dab513b246624d965c5dd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dd1144d3fdde4b369cc2ce4bd2979f99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b2ea8561f279b13e882f2d8a16c81c96e04859a0507934ff9d551f96536d87bb67fce94702e608fd7a03255df5821287ded9c005c33efb6ebc701e270a548477', 'id': 'c9b5e93f-a962-4c73-9cac-6ce287569acd', 'created_at': datetime.datetime(2026, 9, 10, 17, 51, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 51, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9b5e93f-a962-4c73-9cac-6ce287569acd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c5e755a-a607-4cfc-97f0-36467f0ce0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:47 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:51:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Flow 'volume_create_manager' (c55e9951-fe97-4f76-b7c3-4f6f2ef9030c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:51:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc9ba8a-0dd6-437c-bf9c-0e39f0309e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc9ba8a-0dd6-437c-bf9c-0e39f0309e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1202446118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b84e0d-5dac-442c-9bca-c44f0883bfa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f3f47ac069412e8fd6e11ab1d2ba29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:51:48Z,use_quota=True,user_id='96ad9339eff44742ba17a3e54ea7e372',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae61ba6-0cdc-4b29-be42-69b51038b5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae61ba6-0cdc-4b29-be42-69b51038b5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeaa4f38-ece4-4903-b9d2-945dfd087f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:47 devstack cinder-volume[88093]: DEBUG cinder.image.glance [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Creating Keystone auth plugin from conf {{(pid=88093) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 19:51:47 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Volume volume-23399bbd-808f-40c2-a847-aab554bc3359 (23399bbd-808f-40c2-a847-aab554bc3359): created successfully Sep 10 19:51:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c5e755a-a607-4cfc-97f0-36467f0ce0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Flow 'volume_create_manager' (34a760a2-b939-4467-a296-e51dd58c182a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:51:47 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-90e189a0-4162-40ed-9735-e04b83e5057a tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Created volume successfully. Sep 10 19:51:48 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7cfc5b98-45a3-457c-ac05-271556d40866 tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Acquiring lock "cinder-23399bbd-808f-40c2-a847-aab554bc3359-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:51:48 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7cfc5b98-45a3-457c-ac05-271556d40866 tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Lock "cinder-23399bbd-808f-40c2-a847-aab554bc3359-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:51:48 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7cfc5b98-45a3-457c-ac05-271556d40866 tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Acquiring lock "cinder-quobyte-23399bbd-808f-40c2-a847-aab554bc3359" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:51:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeaa4f38-ece4-4903-b9d2-945dfd087f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '09b84e0d-5dac-442c-9bca-c44f0883bfa9', 'volume_name': 'volume-09b84e0d-5dac-442c-9bca-c44f0883bfa9', 'volume_size': 1, 'image_id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cce253731714c6797a2e9bce91009cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'created_at': datetime.datetime(2026, 9, 10, 17, 35, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 35, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a27e2b49-8f0a-4713-bf98-be19979cd55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a27e2b49-8f0a-4713-bf98-be19979cd55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a1a4bce-160d-4e60-b907-18c0d5fccbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:48 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Volume 09b84e0d-5dac-442c-9bca-c44f0883bfa9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-09b84e0d-5dac-442c-9bca-c44f0883bfa9', 'volume_size': 1, 'image_id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cce253731714c6797a2e9bce91009cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'created_at': datetime.datetime(2026, 9, 10, 17, 35, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 35, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 19:51:48 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Trying to clone 09b84e0d-5dac-442c-9bca-c44f0883bfa9 from image ce7b5bdf-521a-42b1-b62b-e8406ccf342b at location (None, [{'url': 'file:///opt/stack/data/glance/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'metadata': {}}]). {{(pid=88093) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 19:51:48 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7cfc5b98-45a3-457c-ac05-271556d40866 tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Lock "cinder-quobyte-23399bbd-808f-40c2-a847-aab554bc3359" acquired by "delete_volume" :: waited 0.047s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:51:48 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29d5649-38ad-48f3-a61b-827f0a36dfda]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:51:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7cfc5b98-45a3-457c-ac05-271556d40866 tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-23399bbd-808f-40c2-a847-aab554bc3359 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:48 devstack sudo[98994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-23399bbd-808f-40c2-a847-aab554bc3359 Sep 10 19:51:48 devstack sudo[98994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:48 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_6li6aa9hdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88093) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 19:51:48 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Image download 20.69 MB at 20.69 MB/s Sep 10 19:51:48 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b0df12-d176-41cc-80e8-369df362f1a3]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:51:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_6li6aa9hdevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:48 devstack sudo[98994]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7cfc5b98-45a3-457c-ac05-271556d40866 tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-23399bbd-808f-40c2-a847-aab554bc3359" returned: 0 in 0.598s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7cfc5b98-45a3-457c-ac05-271556d40866 tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-23399bbd-808f-40c2-a847-aab554bc3359 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:48 devstack sudo[98999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_6li6aa9hdevstack@QuobyteHD Sep 10 19:51:48 devstack sudo[98999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:48 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-23399bbd-808f-40c2-a847-aab554bc3359 Sep 10 19:51:48 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:49 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:49 devstack sudo[98999]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_6li6aa9hdevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:49 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Temporary image ce7b5bdf-521a-42b1-b62b-e8406ccf342b is fetched for user 96ad9339eff44742ba17a3e54ea7e372. {{(pid=88093) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 19:51:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7cfc5b98-45a3-457c-ac05-271556d40866 tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-23399bbd-808f-40c2-a847-aab554bc3359" returned: 0 in 0.292s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7cfc5b98-45a3-457c-ac05-271556d40866 tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Lock "cinder-quobyte-23399bbd-808f-40c2-a847-aab554bc3359" released by "delete_volume" :: held 0.965s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:51:49 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6243a9-a20d-48af-a09d-73b971d67798]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:51:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_6li6aa9hdevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:49 devstack cinder-volume[88093]: WARNING cinder.quota [None req-7cfc5b98-45a3-457c-ac05-271556d40866 tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:51:49 devstack cinder-volume[88093]: WARNING cinder.quota [None req-7cfc5b98-45a3-457c-ac05-271556d40866 tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:51:49 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-7cfc5b98-45a3-457c-ac05-271556d40866 tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Created reservations ['7d33f2c2-d7e8-4282-ac73-8037a7db2399', '961856d0-6316-4451-9085-f55082b73e3a', '4baf472d-d116-4ee8-84c0-ec4b636d20c3', 'b9c57697-23fc-4b9c-8291-cd00357681e0'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:51:49 devstack sudo[99009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_6li6aa9hdevstack@QuobyteHD Sep 10 19:51:49 devstack sudo[99009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7cfc5b98-45a3-457c-ac05-271556d40866 tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7cfc5b98-45a3-457c-ac05-271556d40866 tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7cfc5b98-45a3-457c-ac05-271556d40866 tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:51:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7cfc5b98-45a3-457c-ac05-271556d40866 tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:51:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7cfc5b98-45a3-457c-ac05-271556d40866 tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7cfc5b98-45a3-457c-ac05-271556d40866 tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:49 devstack sudo[99012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:51:49 devstack sudo[99012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:49 devstack sudo[99009]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_6li6aa9hdevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1202446118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b84e0d-5dac-442c-9bca-c44f0883bfa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f3f47ac069412e8fd6e11ab1d2ba29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:51:48Z,use_quota=True,user_id='96ad9339eff44742ba17a3e54ea7e372',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:51:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Creating volume 09b84e0d-5dac-442c-9bca-c44f0883bfa9 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:51:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:51:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:51:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:51:49 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:51:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-09b84e0d-5dac-442c-9bca-c44f0883bfa9 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:49 devstack sudo[99019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-09b84e0d-5dac-442c-9bca-c44f0883bfa9 1073741824 Sep 10 19:51:49 devstack sudo[99019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:49 devstack sudo[99012]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7cfc5b98-45a3-457c-ac05-271556d40866 tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.352s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:49 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-7cfc5b98-45a3-457c-ac05-271556d40866 tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:51:49 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-7cfc5b98-45a3-457c-ac05-271556d40866 tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Deleted volume successfully. Sep 10 19:51:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7cfc5b98-45a3-457c-ac05-271556d40866 tempest-VolumeAndVolumeTypeFromImageTest-2067485689 None] Lock "cinder-23399bbd-808f-40c2-a847-aab554bc3359-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:51:50 devstack sudo[99019]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-09b84e0d-5dac-442c-9bca-c44f0883bfa9 1073741824" returned: 0 in 0.517s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-09b84e0d-5dac-442c-9bca-c44f0883bfa9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:50 devstack sudo[99025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-09b84e0d-5dac-442c-9bca-c44f0883bfa9 Sep 10 19:51:50 devstack sudo[99025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:50 devstack sudo[99025]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-09b84e0d-5dac-442c-9bca-c44f0883bfa9" returned: 0 in 0.328s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:50 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:51:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:50 devstack cinder-volume[88093]: DEBUG cinder.volume.volume_utils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Attempting download of ce7b5bdf-521a-42b1-b62b-e8406ccf342b ((None, [{'url': 'file:///opt/stack/data/glance/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'metadata': {}}])) to volume 09b84e0d-5dac-442c-9bca-c44f0883bfa9. {{(pid=88093) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 19:51:50 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[056cb710-315b-4066-bca6-a6f6957171bf]: (4, 'raw') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:51:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_gz0tsqpc {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:50 devstack sudo[99028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_gz0tsqpc Sep 10 19:51:50 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:51 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_gz0tsqpc" returned: 0 in 0.385s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_gz0tsqpc {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:51 devstack sudo[99032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_gz0tsqpc Sep 10 19:51:51 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:51 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_gz0tsqpc" returned: 1 in 0.378s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_gz0tsqpc' failed. Not Retrying. {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 19:51:51 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2699609-41a9-4d92-882e-8faff891d86c]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:51:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_6li6aa9hdevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:51 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_6li6aa9hdevstack@QuobyteHD Sep 10 19:51:51 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:52 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_6li6aa9hdevstack@QuobyteHD" returned: 0 in 0.555s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:52 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] ce7b5bdf-521a-42b1-b62b-e8406ccf342b was qcow2, converting to qcow2 {{(pid=88093) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 19:51:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_6li6aa9hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-09b84e0d-5dac-442c-9bca-c44f0883bfa9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:52 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_6li6aa9hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-09b84e0d-5dac-442c-9bca-c44f0883bfa9 Sep 10 19:51:52 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:54 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_6li6aa9hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-09b84e0d-5dac-442c-9bca-c44f0883bfa9" returned: 0 in 2.472s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:54 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_6li6aa9hdevstack@QuobyteHD, size 112.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-09b84e0d-5dac-442c-9bca-c44f0883bfa9 {{(pid=88093) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 19:51:54 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Converted 112.00 MB image at 45.28 MB/s Sep 10 19:51:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-09b84e0d-5dac-442c-9bca-c44f0883bfa9 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:54 devstack sudo[99052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-09b84e0d-5dac-442c-9bca-c44f0883bfa9 1G Sep 10 19:51:54 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:55 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-09b84e0d-5dac-442c-9bca-c44f0883bfa9 1G" returned: 0 in 0.391s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:55 devstack cinder-volume[88093]: DEBUG cinder.volume.volume_utils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Downloaded image ce7b5bdf-521a-42b1-b62b-e8406ccf342b ((None, [{'url': 'file:///opt/stack/data/glance/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'metadata': {}}])) to volume 09b84e0d-5dac-442c-9bca-c44f0883bfa9 successfully. {{(pid=88093) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 19:51:55 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Temporary image ce7b5bdf-521a-42b1-b62b-e8406ccf342b for user 96ad9339eff44742ba17a3e54ea7e372 is deleted. {{(pid=88093) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 19:51:55 devstack cinder-volume[88093]: DEBUG cinder.volume.volume_utils [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Marking volume 09b84e0d-5dac-442c-9bca-c44f0883bfa9 as bootable. {{(pid=88093) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 19:51:55 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Copying metadata from image ce7b5bdf-521a-42b1-b62b-e8406ccf342b to 09b84e0d-5dac-442c-9bca-c44f0883bfa9. {{(pid=88093) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 19:51:55 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Creating volume glance metadata for volume 09b84e0d-5dac-442c-9bca-c44f0883bfa9 backed by image ce7b5bdf-521a-42b1-b62b-e8406ccf342b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88093) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 19:51:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a1a4bce-160d-4e60-b907-18c0d5fccbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09b84e0d-5dac-442c-9bca-c44f0883bfa9', 'volume_size': 1, 'image_id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cce253731714c6797a2e9bce91009cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'created_at': datetime.datetime(2026, 9, 10, 17, 35, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 35, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28021e4-f343-48ee-b2ad-82c89fe5186d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:55 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Volume volume-09b84e0d-5dac-442c-9bca-c44f0883bfa9 (09b84e0d-5dac-442c-9bca-c44f0883bfa9): created successfully Sep 10 19:51:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28021e4-f343-48ee-b2ad-82c89fe5186d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Flow 'volume_create_manager' (c55e9951-fe97-4f76-b7c3-4f6f2ef9030c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:51:55 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-efefd921-c715-40c5-b81d-80ca5f9cfd6d tempest-VolumesImageMetadata-1310562390 None] Created volume successfully. Sep 10 19:51:56 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:51:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] Flow 'volume_create_manager' (60a1698b-cbb6-4c30-b102-6eb73de3447e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:51:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbeb5077-7b55-498e-81ce-cd96b4f30dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbeb5077-7b55-498e-81ce-cd96b4f30dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1665490196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed310ac0-5daa-42ac-921d-7555e1a73f10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa72bfbc5edc48999a98a5083feb84b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:51:56Z,use_quota=True,user_id='83ab597f9c934ecab1b156f85097c3fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dec3bf1-0728-45d9-a34e-d561325b69dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dec3bf1-0728-45d9-a34e-d561325b69dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5869b65f-88ce-45dc-b824-f6ebc299dd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5869b65f-88ce-45dc-b824-f6ebc299dd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed310ac0-5daa-42ac-921d-7555e1a73f10', 'volume_name': 'volume-ed310ac0-5daa-42ac-921d-7555e1a73f10', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a41136e-49aa-4d1d-a472-1564fc645657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a41136e-49aa-4d1d-a472-1564fc645657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c9c381-f4fa-4c9c-b99f-8af1ce4ca596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:56 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] Volume ed310ac0-5daa-42ac-921d-7555e1a73f10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed310ac0-5daa-42ac-921d-7555e1a73f10', 'volume_size': 1} Sep 10 19:51:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1665490196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed310ac0-5daa-42ac-921d-7555e1a73f10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa72bfbc5edc48999a98a5083feb84b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:51:56Z,use_quota=True,user_id='83ab597f9c934ecab1b156f85097c3fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:51:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] Creating volume ed310ac0-5daa-42ac-921d-7555e1a73f10 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:51:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:51:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:51:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:51:56 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:51:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ed310ac0-5daa-42ac-921d-7555e1a73f10 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:56 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ed310ac0-5daa-42ac-921d-7555e1a73f10 1073741824 Sep 10 19:51:56 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:56 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ed310ac0-5daa-42ac-921d-7555e1a73f10 1073741824" returned: 0 in 0.513s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ed310ac0-5daa-42ac-921d-7555e1a73f10 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:56 devstack sudo[99064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ed310ac0-5daa-42ac-921d-7555e1a73f10 Sep 10 19:51:56 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:57 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ed310ac0-5daa-42ac-921d-7555e1a73f10" returned: 0 in 0.329s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c9c381-f4fa-4c9c-b99f-8af1ce4ca596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed310ac0-5daa-42ac-921d-7555e1a73f10', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c558db0-9b6c-4e2c-acca-8987ff2622f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:57 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] Volume volume-ed310ac0-5daa-42ac-921d-7555e1a73f10 (ed310ac0-5daa-42ac-921d-7555e1a73f10): created successfully Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c558db0-9b6c-4e2c-acca-8987ff2622f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] Flow 'volume_create_manager' (60a1698b-cbb6-4c30-b102-6eb73de3447e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:51:57 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-4cfc974c-8251-4af7-8d70-1cb6ad0bb954 tempest-VolumesServicesTestJSON-1636577012 None] Created volume successfully. Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1b0fc5f6-e1ce-46c1-aab6-0876eecfd9d6 tempest-VolumesImageMetadata-1310562390 None] Acquiring lock "cinder-09b84e0d-5dac-442c-9bca-c44f0883bfa9-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1b0fc5f6-e1ce-46c1-aab6-0876eecfd9d6 tempest-VolumesImageMetadata-1310562390 None] Lock "cinder-09b84e0d-5dac-442c-9bca-c44f0883bfa9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] Flow 'volume_create_manager' (a9043fde-386a-418f-bdb6-d5666482af47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e28db87b-5a1d-457a-8b90-5a9de31ff077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e28db87b-5a1d-457a-8b90-5a9de31ff077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-756512269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b15db20-6923-405c-beb1-618092564ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61f37527d824e21b9345b302f4beb60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:51:57Z,use_quota=True,user_id='4ec286532b5a4aef8b07c699b0e863b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b2392d-8a3b-4840-a11d-f9ffe2f0e3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b2392d-8a3b-4840-a11d-f9ffe2f0e3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d070bf4-ad5f-4228-8376-344d7ba212a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d070bf4-ad5f-4228-8376-344d7ba212a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b15db20-6923-405c-beb1-618092564ff8', 'volume_name': 'volume-9b15db20-6923-405c-beb1-618092564ff8', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da988f43-7775-4873-a89a-6c44ea28ae24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da988f43-7775-4873-a89a-6c44ea28ae24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8a3a3c1-b800-407f-bf5f-43f06217f45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:57 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] Volume 9b15db20-6923-405c-beb1-618092564ff8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b15db20-6923-405c-beb1-618092564ff8', 'volume_size': 1} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-756512269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b15db20-6923-405c-beb1-618092564ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61f37527d824e21b9345b302f4beb60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:51:57Z,use_quota=True,user_id='4ec286532b5a4aef8b07c699b0e863b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] Creating volume 9b15db20-6923-405c-beb1-618092564ff8 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:51:57 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:57 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8 1073741824 Sep 10 19:51:57 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1b0fc5f6-e1ce-46c1-aab6-0876eecfd9d6 tempest-VolumesImageMetadata-1310562390 None] Acquiring lock "cinder-quobyte-09b84e0d-5dac-442c-9bca-c44f0883bfa9" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1b0fc5f6-e1ce-46c1-aab6-0876eecfd9d6 tempest-VolumesImageMetadata-1310562390 None] Lock "cinder-quobyte-09b84e0d-5dac-442c-9bca-c44f0883bfa9" acquired by "delete_volume" :: waited 0.018s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[611fc15f-dfb3-4ad3-969c-d95c06d28a96]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1b0fc5f6-e1ce-46c1-aab6-0876eecfd9d6 tempest-VolumesImageMetadata-1310562390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-09b84e0d-5dac-442c-9bca-c44f0883bfa9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:57 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-09b84e0d-5dac-442c-9bca-c44f0883bfa9 Sep 10 19:51:57 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] Flow 'volume_create_manager' (940062ce-4a21-4cda-9abb-19da6afca120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8494436-7775-40c6-bff1-0ebded11d6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8494436-7775-40c6-bff1-0ebded11d6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1566274647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c75a041a-4d0f-4097-b5f5-c2f6379b2c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44968d3717a145899709a93e615ad316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:51:58Z,use_quota=True,user_id='67e2aee1bb63447e872253f2f86bff3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dce17d7-bcaf-4877-a8e7-44f96a0c8a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dce17d7-bcaf-4877-a8e7-44f96a0c8a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feedfb31-e95e-4586-ba39-05cd62499209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feedfb31-e95e-4586-ba39-05cd62499209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c75a041a-4d0f-4097-b5f5-c2f6379b2c25', 'volume_name': 'volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a767a057-d198-4dc5-9f33-08e5a2fa5fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a767a057-d198-4dc5-9f33-08e5a2fa5fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbfaf7a3-1338-4a9c-8a7d-1fb4a6d910a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:57 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] Volume c75a041a-4d0f-4097-b5f5-c2f6379b2c25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25', 'volume_size': 1} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:57 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1b0fc5f6-e1ce-46c1-aab6-0876eecfd9d6 tempest-VolumesImageMetadata-1310562390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-09b84e0d-5dac-442c-9bca-c44f0883bfa9" returned: 0 in 0.391s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1b0fc5f6-e1ce-46c1-aab6-0876eecfd9d6 tempest-VolumesImageMetadata-1310562390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-09b84e0d-5dac-442c-9bca-c44f0883bfa9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:57 devstack sudo[99078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-09b84e0d-5dac-442c-9bca-c44f0883bfa9 Sep 10 19:51:57 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:58 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8 1073741824" returned: 0 in 0.504s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:58 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8 Sep 10 19:51:58 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:58 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1b0fc5f6-e1ce-46c1-aab6-0876eecfd9d6 tempest-VolumesImageMetadata-1310562390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-09b84e0d-5dac-442c-9bca-c44f0883bfa9" returned: 0 in 0.261s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1b0fc5f6-e1ce-46c1-aab6-0876eecfd9d6 tempest-VolumesImageMetadata-1310562390 None] Lock "cinder-quobyte-09b84e0d-5dac-442c-9bca-c44f0883bfa9" released by "delete_volume" :: held 0.696s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-1b0fc5f6-e1ce-46c1-aab6-0876eecfd9d6 tempest-VolumesImageMetadata-1310562390 None] Created reservations ['cb04badd-9ff0-4693-b114-e30ca8d7b16b', '0895f9cc-986c-4b30-b324-eb8a96b21484', '7ecbf357-bb6b-4edd-8f40-29f175811390', '3b6b80cf-0332-4ac8-812a-a9f457128d58'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:51:58 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-25ea1bce-acf6-4f31-84d0-9df2086fda40 tempest-VolumesServicesTestJSON-1636577012 None] Acquiring lock "cinder-ed310ac0-5daa-42ac-921d-7555e1a73f10-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8" returned: 0 in 0.285s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.492s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1566274647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c75a041a-4d0f-4097-b5f5-c2f6379b2c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44968d3717a145899709a93e615ad316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:51:58Z,use_quota=True,user_id='67e2aee1bb63447e872253f2f86bff3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] Creating volume c75a041a-4d0f-4097-b5f5-c2f6379b2c25 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:51:58 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8a3a3c1-b800-407f-bf5f-43f06217f45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b15db20-6923-405c-beb1-618092564ff8', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e9ddb9-5886-47d0-9dbd-7b9b476d88cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:58 devstack sudo[99084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25 1073741824 Sep 10 19:51:58 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-25ea1bce-acf6-4f31-84d0-9df2086fda40 tempest-VolumesServicesTestJSON-1636577012 None] Lock "cinder-ed310ac0-5daa-42ac-921d-7555e1a73f10-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:51:58 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] Volume volume-9b15db20-6923-405c-beb1-618092564ff8 (9b15db20-6923-405c-beb1-618092564ff8): created successfully Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e9ddb9-5886-47d0-9dbd-7b9b476d88cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] Flow 'volume_create_manager' (a9043fde-386a-418f-bdb6-d5666482af47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:51:58 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-58e6b357-4f27-49b8-8a50-02d796c2ab56 tempest-VolumeDependencyTests-1461652796 None] Created volume successfully. Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-25ea1bce-acf6-4f31-84d0-9df2086fda40 tempest-VolumesServicesTestJSON-1636577012 None] Acquiring lock "cinder-quobyte-ed310ac0-5daa-42ac-921d-7555e1a73f10" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1b0fc5f6-e1ce-46c1-aab6-0876eecfd9d6 tempest-VolumesImageMetadata-1310562390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1b0fc5f6-e1ce-46c1-aab6-0876eecfd9d6 tempest-VolumesImageMetadata-1310562390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1b0fc5f6-e1ce-46c1-aab6-0876eecfd9d6 tempest-VolumesImageMetadata-1310562390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1b0fc5f6-e1ce-46c1-aab6-0876eecfd9d6 tempest-VolumesImageMetadata-1310562390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1b0fc5f6-e1ce-46c1-aab6-0876eecfd9d6 tempest-VolumesImageMetadata-1310562390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1b0fc5f6-e1ce-46c1-aab6-0876eecfd9d6 tempest-VolumesImageMetadata-1310562390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-25ea1bce-acf6-4f31-84d0-9df2086fda40 tempest-VolumesServicesTestJSON-1636577012 None] Lock "cinder-quobyte-ed310ac0-5daa-42ac-921d-7555e1a73f10" acquired by "delete_volume" :: waited 0.038s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:51:58 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:51:58 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ad1327-9bb8-46b2-9935-7a2daab98b91]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-25ea1bce-acf6-4f31-84d0-9df2086fda40 tempest-VolumesServicesTestJSON-1636577012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ed310ac0-5daa-42ac-921d-7555e1a73f10 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:58 devstack sudo[99088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ed310ac0-5daa-42ac-921d-7555e1a73f10 Sep 10 19:51:58 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:58 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1b0fc5f6-e1ce-46c1-aab6-0876eecfd9d6 tempest-VolumesImageMetadata-1310562390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.318s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-1b0fc5f6-e1ce-46c1-aab6-0876eecfd9d6 tempest-VolumesImageMetadata-1310562390 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:51:58 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-1b0fc5f6-e1ce-46c1-aab6-0876eecfd9d6 tempest-VolumesImageMetadata-1310562390 None] Deleted volume successfully. Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1b0fc5f6-e1ce-46c1-aab6-0876eecfd9d6 tempest-VolumesImageMetadata-1310562390 None] Lock "cinder-09b84e0d-5dac-442c-9bca-c44f0883bfa9-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:51:58 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25 1073741824" returned: 0 in 0.624s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:59 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-25ea1bce-acf6-4f31-84d0-9df2086fda40 tempest-VolumesServicesTestJSON-1636577012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ed310ac0-5daa-42ac-921d-7555e1a73f10" returned: 0 in 0.486s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-25ea1bce-acf6-4f31-84d0-9df2086fda40 tempest-VolumesServicesTestJSON-1636577012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ed310ac0-5daa-42ac-921d-7555e1a73f10 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:59 devstack sudo[99098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ed310ac0-5daa-42ac-921d-7555e1a73f10 Sep 10 19:51:59 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:59 devstack sudo[99099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25 Sep 10 19:51:59 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:59 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-25ea1bce-acf6-4f31-84d0-9df2086fda40 tempest-VolumesServicesTestJSON-1636577012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ed310ac0-5daa-42ac-921d-7555e1a73f10" returned: 0 in 0.276s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:59 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:59 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-25ea1bce-acf6-4f31-84d0-9df2086fda40 tempest-VolumesServicesTestJSON-1636577012 None] Lock "cinder-quobyte-ed310ac0-5daa-42ac-921d-7555e1a73f10" released by "delete_volume" :: held 0.818s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:51:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25" returned: 0 in 0.284s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:59 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:51:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbfaf7a3-1338-4a9c-8a7d-1fb4a6d910a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f4ecce-c556-41b5-b952-da44ada2dae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:51:59 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] Volume volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25 (c75a041a-4d0f-4097-b5f5-c2f6379b2c25): created successfully Sep 10 19:51:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f4ecce-c556-41b5-b952-da44ada2dae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:51:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] Flow 'volume_create_manager' (940062ce-4a21-4cda-9abb-19da6afca120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:51:59 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-af1c523e-6961-4fac-be41-6c6aef088255 req-be230995-35af-4b88-99dd-89500b20800d tempest-VolumesSnapshotsTestJSON-397711982 None] Created volume successfully. Sep 10 19:51:59 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-25ea1bce-acf6-4f31-84d0-9df2086fda40 tempest-VolumesServicesTestJSON-1636577012 None] Created reservations ['cffc62b3-378e-4fbc-b817-7b08170cc847', '0e95ae5b-7384-4ec7-9714-dcfd01a8eb19', '7b4a464e-addc-472b-a411-f43a13fd43f7', 'a39e4bc5-56b7-43ec-aaed-7e040ddc6f77'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:51:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-25ea1bce-acf6-4f31-84d0-9df2086fda40 tempest-VolumesServicesTestJSON-1636577012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-25ea1bce-acf6-4f31-84d0-9df2086fda40 tempest-VolumesServicesTestJSON-1636577012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:59 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-25ea1bce-acf6-4f31-84d0-9df2086fda40 tempest-VolumesServicesTestJSON-1636577012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:51:59 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-25ea1bce-acf6-4f31-84d0-9df2086fda40 tempest-VolumesServicesTestJSON-1636577012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:51:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-25ea1bce-acf6-4f31-84d0-9df2086fda40 tempest-VolumesServicesTestJSON-1636577012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:51:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-25ea1bce-acf6-4f31-84d0-9df2086fda40 tempest-VolumesServicesTestJSON-1636577012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:59 devstack sudo[99105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:51:59 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:51:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e17ac300-e260-45b6-93b9-d0b576d7c6b9 tempest-VolumeDependencyTests-1461652796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:51:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e17ac300-e260-45b6-93b9-d0b576d7c6b9 tempest-VolumeDependencyTests-1461652796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:51:59 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-e17ac300-e260-45b6-93b9-d0b576d7c6b9 tempest-VolumeDependencyTests-1461652796 None] Creating offline snapshot 475a25b4-ddd4-4fd0-854e-382db687f743 of volume 9b15db20-6923-405c-beb1-618092564ff8 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 19:51:59 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cf4944-380e-4f1c-9b5c-297104e42947]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:51:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e17ac300-e260-45b6-93b9-d0b576d7c6b9 tempest-VolumeDependencyTests-1461652796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:51:59 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root Sep 10 19:51:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-25ea1bce-acf6-4f31-84d0-9df2086fda40 tempest-VolumesServicesTestJSON-1636577012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.330s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:51:59 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-25ea1bce-acf6-4f31-84d0-9df2086fda40 tempest-VolumesServicesTestJSON-1636577012 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:51:59 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-25ea1bce-acf6-4f31-84d0-9df2086fda40 tempest-VolumesServicesTestJSON-1636577012 None] Deleted volume successfully. Sep 10 19:51:59 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-25ea1bce-acf6-4f31-84d0-9df2086fda40 tempest-VolumesServicesTestJSON-1636577012 None] Lock "cinder-ed310ac0-5daa-42ac-921d-7555e1a73f10-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:51:59 devstack sudo[99108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8 Sep 10 19:51:59 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-9e441952-d13c-44b8-a8af-086a480f7b11 req-65617b52-3f61-46b7-aa84-259054bf6a52 tempest-VolumesSnapshotsTestJSON-397711982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:00 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e17ac300-e260-45b6-93b9-d0b576d7c6b9 tempest-VolumeDependencyTests-1461652796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8" returned: 0 in 0.463s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e17ac300-e260-45b6-93b9-d0b576d7c6b9 tempest-VolumeDependencyTests-1461652796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8.475a25b4-ddd4-4fd0-854e-382db687f743 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:00 devstack sudo[99113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8.475a25b4-ddd4-4fd0-854e-382db687f743 1G Sep 10 19:52:00 devstack sudo[99113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:00 devstack sudo[99113]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e17ac300-e260-45b6-93b9-d0b576d7c6b9 tempest-VolumeDependencyTests-1461652796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8.475a25b4-ddd4-4fd0-854e-382db687f743 1G" returned: 0 in 0.528s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e17ac300-e260-45b6-93b9-d0b576d7c6b9 tempest-VolumeDependencyTests-1461652796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b15db20-6923-405c-beb1-618092564ff8 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8.475a25b4-ddd4-4fd0-854e-382db687f743 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:00 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b15db20-6923-405c-beb1-618092564ff8 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8.475a25b4-ddd4-4fd0-854e-382db687f743 Sep 10 19:52:00 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:01 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e17ac300-e260-45b6-93b9-d0b576d7c6b9 tempest-VolumeDependencyTests-1461652796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b15db20-6923-405c-beb1-618092564ff8 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8.475a25b4-ddd4-4fd0-854e-382db687f743" returned: 0 in 0.327s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:01 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-e17ac300-e260-45b6-93b9-d0b576d7c6b9 tempest-VolumeDependencyTests-1461652796 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8.475a25b4-ddd4-4fd0-854e-382db687f743 is being set with open permissions: ugo+rw Sep 10 19:52:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e17ac300-e260-45b6-93b9-d0b576d7c6b9 tempest-VolumeDependencyTests-1461652796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8.475a25b4-ddd4-4fd0-854e-382db687f743 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:01 devstack sudo[99124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8.475a25b4-ddd4-4fd0-854e-382db687f743 Sep 10 19:52:01 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:01 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e17ac300-e260-45b6-93b9-d0b576d7c6b9 tempest-VolumeDependencyTests-1461652796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8.475a25b4-ddd4-4fd0-854e-382db687f743" returned: 0 in 0.253s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:01 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=149,cinder:UPDATE=161,cinder:INSERT=50,cinder:DELETE=9 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:52:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e17ac300-e260-45b6-93b9-d0b576d7c6b9 tempest-VolumeDependencyTests-1461652796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:01 devstack sudo[99127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8.info Sep 10 19:52:01 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:01 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e17ac300-e260-45b6-93b9-d0b576d7c6b9 tempest-VolumeDependencyTests-1461652796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8.info" returned: 0 in 0.282s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:01 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-e17ac300-e260-45b6-93b9-d0b576d7c6b9 tempest-VolumeDependencyTests-1461652796 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8.info is being set with open permissions: ugo+rw Sep 10 19:52:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e17ac300-e260-45b6-93b9-d0b576d7c6b9 tempest-VolumeDependencyTests-1461652796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:01 devstack sudo[99130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8.info Sep 10 19:52:01 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:02 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e17ac300-e260-45b6-93b9-d0b576d7c6b9 tempest-VolumeDependencyTests-1461652796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8.info" returned: 0 in 0.320s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e17ac300-e260-45b6-93b9-d0b576d7c6b9 tempest-VolumeDependencyTests-1461652796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.303s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-9e441952-d13c-44b8-a8af-086a480f7b11 req-65617b52-3f61-46b7-aa84-259054bf6a52 tempest-VolumesSnapshotsTestJSON-397711982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.818s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:02 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [req-9e441952-d13c-44b8-a8af-086a480f7b11 req-65617b52-3f61-46b7-aa84-259054bf6a52 tempest-VolumesSnapshotsTestJSON-397711982 None] Creating offline snapshot 9db3e846-fd29-4c1b-8a84-a6eca3c45db8 of volume c75a041a-4d0f-4097-b5f5-c2f6379b2c25 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 19:52:02 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d399c00-9aa7-4213-a90d-2caa4e0935ba]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-9e441952-d13c-44b8-a8af-086a480f7b11 req-65617b52-3f61-46b7-aa84-259054bf6a52 tempest-VolumesSnapshotsTestJSON-397711982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:02 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-e17ac300-e260-45b6-93b9-d0b576d7c6b9 tempest-VolumeDependencyTests-1461652796 None] Create snapshot completed successfully Sep 10 19:52:02 devstack sudo[99133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25 Sep 10 19:52:02 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:02 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-9e441952-d13c-44b8-a8af-086a480f7b11 req-65617b52-3f61-46b7-aa84-259054bf6a52 tempest-VolumesSnapshotsTestJSON-397711982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25" returned: 0 in 0.451s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-9e441952-d13c-44b8-a8af-086a480f7b11 req-65617b52-3f61-46b7-aa84-259054bf6a52 tempest-VolumesSnapshotsTestJSON-397711982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25.9db3e846-fd29-4c1b-8a84-a6eca3c45db8 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:02 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25.9db3e846-fd29-4c1b-8a84-a6eca3c45db8 1G Sep 10 19:52:02 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:03 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-9e441952-d13c-44b8-a8af-086a480f7b11 req-65617b52-3f61-46b7-aa84-259054bf6a52 tempest-VolumesSnapshotsTestJSON-397711982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25.9db3e846-fd29-4c1b-8a84-a6eca3c45db8 1G" returned: 0 in 0.664s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-9e441952-d13c-44b8-a8af-086a480f7b11 req-65617b52-3f61-46b7-aa84-259054bf6a52 tempest-VolumesSnapshotsTestJSON-397711982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25.9db3e846-fd29-4c1b-8a84-a6eca3c45db8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:03 devstack sudo[99143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25.9db3e846-fd29-4c1b-8a84-a6eca3c45db8 Sep 10 19:52:03 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:03 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:52:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Flow 'volume_create_manager' (6721e72f-4c17-4f14-a0e5-475052608081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:52:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c490c933-f8c5-4c72-806f-eb6d0c06814e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:03 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c490c933-f8c5-4c72-806f-eb6d0c06814e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1715169866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b4228e6-3bfc-418b-9db3-ce83ca0136dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61f37527d824e21b9345b302f4beb60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=475a25b4-ddd4-4fd0-854e-382db687f743,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:52:04Z,use_quota=True,user_id='4ec286532b5a4aef8b07c699b0e863b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a4957f-4bcc-4ee0-9228-4936224f4e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a4957f-4bcc-4ee0-9228-4936224f4e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c7ee4d-d097-4a03-9b84-7011b1a9df1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c7ee4d-d097-4a03-9b84-7011b1a9df1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4b4228e6-3bfc-418b-9db3-ce83ca0136dd', 'volume_name': 'volume-4b4228e6-3bfc-418b-9db3-ce83ca0136dd', 'volume_size': 1, 'snapshot_id': '475a25b4-ddd4-4fd0-854e-382db687f743'}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee09dcb-bb7d-404a-90f5-61626a4ba900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee09dcb-bb7d-404a-90f5-61626a4ba900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b34f6e6f-a699-4511-9988-806a6859b2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:03 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Volume 4b4228e6-3bfc-418b-9db3-ce83ca0136dd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4b4228e6-3bfc-418b-9db3-ce83ca0136dd', 'volume_size': 1, 'snapshot_id': '475a25b4-ddd4-4fd0-854e-382db687f743'} Sep 10 19:52:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-9e441952-d13c-44b8-a8af-086a480f7b11 req-65617b52-3f61-46b7-aa84-259054bf6a52 tempest-VolumesSnapshotsTestJSON-397711982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25.9db3e846-fd29-4c1b-8a84-a6eca3c45db8" returned: 0 in 0.542s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:03 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [req-9e441952-d13c-44b8-a8af-086a480f7b11 req-65617b52-3f61-46b7-aa84-259054bf6a52 tempest-VolumesSnapshotsTestJSON-397711982 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25.9db3e846-fd29-4c1b-8a84-a6eca3c45db8 is being set with open permissions: ugo+rw Sep 10 19:52:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-9e441952-d13c-44b8-a8af-086a480f7b11 req-65617b52-3f61-46b7-aa84-259054bf6a52 tempest-VolumesSnapshotsTestJSON-397711982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25.9db3e846-fd29-4c1b-8a84-a6eca3c45db8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:03 devstack sudo[99149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25.9db3e846-fd29-4c1b-8a84-a6eca3c45db8 Sep 10 19:52:03 devstack sudo[99149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:03 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:52:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:52:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:52:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:03 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:52:03 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:04 devstack sudo[99149]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-9e441952-d13c-44b8-a8af-086a480f7b11 req-65617b52-3f61-46b7-aa84-259054bf6a52 tempest-VolumesSnapshotsTestJSON-397711982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25.9db3e846-fd29-4c1b-8a84-a6eca3c45db8" returned: 0 in 0.320s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:04 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-9e441952-d13c-44b8-a8af-086a480f7b11 req-65617b52-3f61-46b7-aa84-259054bf6a52 tempest-VolumesSnapshotsTestJSON-397711982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.300s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:04 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:52:04 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager._thread_info {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:52:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread count: 28 {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 19:52:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread info: [<_MainThread(MainThread, started 138417491665024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 19:52:04 devstack sudo[99155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25.info Sep 10 19:52:04 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:04 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-9e441952-d13c-44b8-a8af-086a480f7b11 req-65617b52-3f61-46b7-aa84-259054bf6a52 tempest-VolumesSnapshotsTestJSON-397711982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25.info" returned: 0 in 0.291s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:04 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [req-9e441952-d13c-44b8-a8af-086a480f7b11 req-65617b52-3f61-46b7-aa84-259054bf6a52 tempest-VolumesSnapshotsTestJSON-397711982 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25.info is being set with open permissions: ugo+rw Sep 10 19:52:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-9e441952-d13c-44b8-a8af-086a480f7b11 req-65617b52-3f61-46b7-aa84-259054bf6a52 tempest-VolumesSnapshotsTestJSON-397711982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:04 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25.info Sep 10 19:52:04 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:04 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-9e441952-d13c-44b8-a8af-086a480f7b11 req-65617b52-3f61-46b7-aa84-259054bf6a52 tempest-VolumesSnapshotsTestJSON-397711982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25.info" returned: 0 in 0.288s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-9e441952-d13c-44b8-a8af-086a480f7b11 req-65617b52-3f61-46b7-aa84-259054bf6a52 tempest-VolumesSnapshotsTestJSON-397711982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.676s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.951s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:04 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Acquiring lock "cinder-quobyte-475a25b4-ddd4-4fd0-854e-382db687f743-4b4228e6-3bfc-418b-9db3-ce83ca0136dd" by "_create_volume_from_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:04 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Lock "cinder-quobyte-475a25b4-ddd4-4fd0-854e-382db687f743-4b4228e6-3bfc-418b-9db3-ce83ca0136dd" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Creating volume 4b4228e6-3bfc-418b-9db3-ce83ca0136dd from snapshot 475a25b4-ddd4-4fd0-854e-382db687f743 {{(pid=88093) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 10 19:52:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:52:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:52:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:52:04 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Acquiring lock "cinder-quobyte-4b4228e6-3bfc-418b-9db3-ce83ca0136dd" by "_copy_volume_from_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:04 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-9e441952-d13c-44b8-a8af-086a480f7b11 req-65617b52-3f61-46b7-aa84-259054bf6a52 tempest-VolumesSnapshotsTestJSON-397711982 None] Create snapshot completed successfully Sep 10 19:52:04 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Lock "cinder-quobyte-4b4228e6-3bfc-418b-9db3-ce83ca0136dd" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] snapshot: 475a25b4-ddd4-4fd0-854e-382db687f743, volume: 4b4228e6-3bfc-418b-9db3-ce83ca0136dd, {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 19:52:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:52:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:52:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:04 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[4173b01f-66b1-4107-8b33-0861e6becb9f]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8.475a25b4-ddd4-4fd0-854e-382db687f743 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:05 devstack sudo[99161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8.475a25b4-ddd4-4fd0-854e-382db687f743 Sep 10 19:52:05 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-0726223c-7f29-4bb4-8ac0-7e33af1cf2be req-1151c1e1-0ce1-4f81-9708-4f0b2e199846 tempest-VolumesSnapshotsTestJSON-397711982 None] Acquiring lock "cinder-9db3e846-fd29-4c1b-8a84-a6eca3c45db8-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-0726223c-7f29-4bb4-8ac0-7e33af1cf2be req-1151c1e1-0ce1-4f81-9708-4f0b2e199846 tempest-VolumesSnapshotsTestJSON-397711982 None] Lock "cinder-9db3e846-fd29-4c1b-8a84-a6eca3c45db8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-0726223c-7f29-4bb4-8ac0-7e33af1cf2be req-1151c1e1-0ce1-4f81-9708-4f0b2e199846 tempest-VolumesSnapshotsTestJSON-397711982 None] Acquiring lock "cinder-quobyte-c75a041a-4d0f-4097-b5f5-c2f6379b2c25" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-0726223c-7f29-4bb4-8ac0-7e33af1cf2be req-1151c1e1-0ce1-4f81-9708-4f0b2e199846 tempest-VolumesSnapshotsTestJSON-397711982 None] Lock "cinder-quobyte-c75a041a-4d0f-4097-b5f5-c2f6379b2c25" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-0726223c-7f29-4bb4-8ac0-7e33af1cf2be req-1151c1e1-0ce1-4f81-9708-4f0b2e199846 tempest-VolumesSnapshotsTestJSON-397711982 None] Acquiring lock "cinder-quobyte-9db3e846-fd29-4c1b-8a84-a6eca3c45db8" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-0726223c-7f29-4bb4-8ac0-7e33af1cf2be req-1151c1e1-0ce1-4f81-9708-4f0b2e199846 tempest-VolumesSnapshotsTestJSON-397711982 None] Lock "cinder-quobyte-9db3e846-fd29-4c1b-8a84-a6eca3c45db8" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [req-0726223c-7f29-4bb4-8ac0-7e33af1cf2be req-1151c1e1-0ce1-4f81-9708-4f0b2e199846 tempest-VolumesSnapshotsTestJSON-397711982 None] Deleting offline snapshot 9db3e846-fd29-4c1b-8a84-a6eca3c45db8 of volume c75a041a-4d0f-4097-b5f5-c2f6379b2c25 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [req-0726223c-7f29-4bb4-8ac0-7e33af1cf2be req-1151c1e1-0ce1-4f81-9708-4f0b2e199846 tempest-VolumesSnapshotsTestJSON-397711982 None] snapshot_file for this snap is: volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25.9db3e846-fd29-4c1b-8a84-a6eca3c45db8 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54d69d0-74c5-4c9c-8170-5bf88de5e0dd]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-0726223c-7f29-4bb4-8ac0-7e33af1cf2be req-1151c1e1-0ce1-4f81-9708-4f0b2e199846 tempest-VolumesSnapshotsTestJSON-397711982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25.9db3e846-fd29-4c1b-8a84-a6eca3c45db8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:05 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8.475a25b4-ddd4-4fd0-854e-382db687f743" returned: 0 in 0.476s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b15db20-6923-405c-beb1-618092564ff8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb3dc21-a429-4f84-af76-c32fb11c1879]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:05 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25.9db3e846-fd29-4c1b-8a84-a6eca3c45db8 Sep 10 19:52:05 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:05 devstack sudo[99167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8 Sep 10 19:52:05 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:52:05 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] Flow 'volume_create_manager' (616534a6-2384-4ae9-9d15-3c1a48f131a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (430bd9cb-5fc0-448f-a2b7-c26ccdb9575f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-0726223c-7f29-4bb4-8ac0-7e33af1cf2be req-1151c1e1-0ce1-4f81-9708-4f0b2e199846 tempest-VolumesSnapshotsTestJSON-397711982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25.9db3e846-fd29-4c1b-8a84-a6eca3c45db8" returned: 0 in 0.472s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [req-0726223c-7f29-4bb4-8ac0-7e33af1cf2be req-1151c1e1-0ce1-4f81-9708-4f0b2e199846 tempest-VolumesSnapshotsTestJSON-397711982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (430bd9cb-5fc0-448f-a2b7-c26ccdb9575f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-17647768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c41de95-f89d-4298-9d84-efc2fe356ccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5877a1a2074a289da96e6f697d40f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:52:06Z,use_quota=True,user_id='21f9f8bbd8874f67a96711a8638e05c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f09b31fb-359a-4e20-9685-65e21820f4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f09b31fb-359a-4e20-9685-65e21820f4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdbe0fda-916c-4fac-8efe-1e590d0efa8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdbe0fda-916c-4fac-8efe-1e590d0efa8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c41de95-f89d-4298-9d84-efc2fe356ccf', 'volume_name': 'volume-4c41de95-f89d-4298-9d84-efc2fe356ccf', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f75633c-d232-440f-81ef-37c1a79b3e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f75633c-d232-440f-81ef-37c1a79b3e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8608a162-d5ba-4be0-a455-e1429307d77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:05 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] Volume 4c41de95-f89d-4298-9d84-efc2fe356ccf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c41de95-f89d-4298-9d84-efc2fe356ccf', 'volume_size': 1} Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[2830f754-fed7-4ce9-a694-70d6473f0465]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-0726223c-7f29-4bb4-8ac0-7e33af1cf2be req-1151c1e1-0ce1-4f81-9708-4f0b2e199846 tempest-VolumesSnapshotsTestJSON-397711982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:05 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8" returned: 0 in 0.515s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8 {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Creating direct copy from snapshot {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG cinder.utils [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Path /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4b4228e6-3bfc-418b-9db3-ce83ca0136dd not found in is_blk_device check {{(pid=88093) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 19:52:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4b4228e6-3bfc-418b-9db3-ce83ca0136dd {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:05 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4b4228e6-3bfc-418b-9db3-ce83ca0136dd Sep 10 19:52:05 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:06 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25 Sep 10 19:52:06 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:06 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-0726223c-7f29-4bb4-8ac0-7e33af1cf2be req-1151c1e1-0ce1-4f81-9708-4f0b2e199846 tempest-VolumesSnapshotsTestJSON-397711982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25" returned: 0 in 0.427s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-0726223c-7f29-4bb4-8ac0-7e33af1cf2be req-1151c1e1-0ce1-4f81-9708-4f0b2e199846 tempest-VolumesSnapshotsTestJSON-397711982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25.9db3e846-fd29-4c1b-8a84-a6eca3c45db8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:06 devstack sudo[99186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25.9db3e846-fd29-4c1b-8a84-a6eca3c45db8 Sep 10 19:52:06 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:06 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-0726223c-7f29-4bb4-8ac0-7e33af1cf2be req-1151c1e1-0ce1-4f81-9708-4f0b2e199846 tempest-VolumesSnapshotsTestJSON-397711982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25.9db3e846-fd29-4c1b-8a84-a6eca3c45db8" returned: 0 in 0.647s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-0726223c-7f29-4bb4-8ac0-7e33af1cf2be req-1151c1e1-0ce1-4f81-9708-4f0b2e199846 tempest-VolumesSnapshotsTestJSON-397711982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25.9db3e846-fd29-4c1b-8a84-a6eca3c45db8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:07 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25.9db3e846-fd29-4c1b-8a84-a6eca3c45db8 Sep 10 19:52:07 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:07 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-0726223c-7f29-4bb4-8ac0-7e33af1cf2be req-1151c1e1-0ce1-4f81-9708-4f0b2e199846 tempest-VolumesSnapshotsTestJSON-397711982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25.9db3e846-fd29-4c1b-8a84-a6eca3c45db8" returned: 0 in 0.612s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-0726223c-7f29-4bb4-8ac0-7e33af1cf2be req-1151c1e1-0ce1-4f81-9708-4f0b2e199846 tempest-VolumesSnapshotsTestJSON-397711982 None] Lock "cinder-quobyte-9db3e846-fd29-4c1b-8a84-a6eca3c45db8" released by "_delete_snapshot" :: held 2.415s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-0726223c-7f29-4bb4-8ac0-7e33af1cf2be req-1151c1e1-0ce1-4f81-9708-4f0b2e199846 tempest-VolumesSnapshotsTestJSON-397711982 None] Lock "cinder-quobyte-c75a041a-4d0f-4097-b5f5-c2f6379b2c25" released by "delete_snapshot" :: held 2.461s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:07 devstack cinder-volume[88093]: DEBUG cinder.quota [req-0726223c-7f29-4bb4-8ac0-7e33af1cf2be req-1151c1e1-0ce1-4f81-9708-4f0b2e199846 tempest-VolumesSnapshotsTestJSON-397711982 None] Created reservations ['2ce12f10-b581-43b7-a3c5-a75e65ec23ae', 'e6e70101-d2f3-4a3e-9597-3cb776ff988f', '713494cd-2d05-455c-8c1d-c5595420b14d', '6d8502d3-8cc7-417c-94ec-5cab7485f3e6'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:52:08 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-0726223c-7f29-4bb4-8ac0-7e33af1cf2be req-1151c1e1-0ce1-4f81-9708-4f0b2e199846 tempest-VolumesSnapshotsTestJSON-397711982 None] Delete snapshot completed successfully. Sep 10 19:52:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-0726223c-7f29-4bb4-8ac0-7e33af1cf2be req-1151c1e1-0ce1-4f81-9708-4f0b2e199846 tempest-VolumesSnapshotsTestJSON-397711982 None] Lock "cinder-9db3e846-fd29-4c1b-8a84-a6eca3c45db8-delete_snapshot" released by "delete_snapshot" :: held 2.928s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-a85a8636-ea1c-474d-8516-2877e5883ffb req-c5882d1d-5b21-45c9-a5d0-d855006bed9d tempest-VolumesSnapshotsTestJSON-397711982 None] Acquiring lock "cinder-c75a041a-4d0f-4097-b5f5-c2f6379b2c25-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-a85a8636-ea1c-474d-8516-2877e5883ffb req-c5882d1d-5b21-45c9-a5d0-d855006bed9d tempest-VolumesSnapshotsTestJSON-397711982 None] Lock "cinder-c75a041a-4d0f-4097-b5f5-c2f6379b2c25-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-a85a8636-ea1c-474d-8516-2877e5883ffb req-c5882d1d-5b21-45c9-a5d0-d855006bed9d tempest-VolumesSnapshotsTestJSON-397711982 None] Acquiring lock "cinder-quobyte-c75a041a-4d0f-4097-b5f5-c2f6379b2c25" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:09 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-a85a8636-ea1c-474d-8516-2877e5883ffb req-c5882d1d-5b21-45c9-a5d0-d855006bed9d tempest-VolumesSnapshotsTestJSON-397711982 None] Lock "cinder-quobyte-c75a041a-4d0f-4097-b5f5-c2f6379b2c25" acquired by "delete_volume" :: waited 0.060s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:09 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fcfe8a-25b8-4987-a730-c3278bed5693]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-a85a8636-ea1c-474d-8516-2877e5883ffb req-c5882d1d-5b21-45c9-a5d0-d855006bed9d tempest-VolumesSnapshotsTestJSON-397711982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:09 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25 Sep 10 19:52:09 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:10 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-a85a8636-ea1c-474d-8516-2877e5883ffb req-c5882d1d-5b21-45c9-a5d0-d855006bed9d tempest-VolumesSnapshotsTestJSON-397711982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25" returned: 0 in 1.011s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-a85a8636-ea1c-474d-8516-2877e5883ffb req-c5882d1d-5b21-45c9-a5d0-d855006bed9d tempest-VolumesSnapshotsTestJSON-397711982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:10 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25 Sep 10 19:52:10 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:10 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-a85a8636-ea1c-474d-8516-2877e5883ffb req-c5882d1d-5b21-45c9-a5d0-d855006bed9d tempest-VolumesSnapshotsTestJSON-397711982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c75a041a-4d0f-4097-b5f5-c2f6379b2c25" returned: 0 in 0.756s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-a85a8636-ea1c-474d-8516-2877e5883ffb req-c5882d1d-5b21-45c9-a5d0-d855006bed9d tempest-VolumesSnapshotsTestJSON-397711982 None] Lock "cinder-quobyte-c75a041a-4d0f-4097-b5f5-c2f6379b2c25" released by "delete_volume" :: held 1.936s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:11 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4b4228e6-3bfc-418b-9db3-ce83ca0136dd" returned: 0 in 5.096s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:11 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Image conversion details: src /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8, size 1024.00 MB, duration 5.10 sec, destination /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4b4228e6-3bfc-418b-9db3-ce83ca0136dd {{(pid=88093) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 19:52:11 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Converted 1024.00 MB image at 200.92 MB/s Sep 10 19:52:11 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4b4228e6-3bfc-418b-9db3-ce83ca0136dd is being set with open permissions: ugo+rw Sep 10 19:52:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4b4228e6-3bfc-418b-9db3-ce83ca0136dd {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:11 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4b4228e6-3bfc-418b-9db3-ce83ca0136dd Sep 10 19:52:11 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:11 devstack cinder-volume[88093]: DEBUG cinder.quota [req-a85a8636-ea1c-474d-8516-2877e5883ffb req-c5882d1d-5b21-45c9-a5d0-d855006bed9d tempest-VolumesSnapshotsTestJSON-397711982 None] Created reservations ['4f33d145-05cd-4dc0-be1d-1a246728fac8', '999a2de9-3b8c-4c21-96be-7dd316f2bb80', 'fcdf5d07-e4ef-4796-8ab7-6f71c3829c27', '4c5ae479-abc0-4589-889f-dfebba90bdfb'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:52:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-a85a8636-ea1c-474d-8516-2877e5883ffb req-c5882d1d-5b21-45c9-a5d0-d855006bed9d tempest-VolumesSnapshotsTestJSON-397711982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-a85a8636-ea1c-474d-8516-2877e5883ffb req-c5882d1d-5b21-45c9-a5d0-d855006bed9d tempest-VolumesSnapshotsTestJSON-397711982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [req-a85a8636-ea1c-474d-8516-2877e5883ffb req-c5882d1d-5b21-45c9-a5d0-d855006bed9d tempest-VolumesSnapshotsTestJSON-397711982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:52:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [req-a85a8636-ea1c-474d-8516-2877e5883ffb req-c5882d1d-5b21-45c9-a5d0-d855006bed9d tempest-VolumesSnapshotsTestJSON-397711982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:52:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-a85a8636-ea1c-474d-8516-2877e5883ffb req-c5882d1d-5b21-45c9-a5d0-d855006bed9d tempest-VolumesSnapshotsTestJSON-397711982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-a85a8636-ea1c-474d-8516-2877e5883ffb req-c5882d1d-5b21-45c9-a5d0-d855006bed9d tempest-VolumesSnapshotsTestJSON-397711982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:11 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:52:11 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:11 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4b4228e6-3bfc-418b-9db3-ce83ca0136dd" returned: 0 in 0.296s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:11 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Lock "cinder-quobyte-4b4228e6-3bfc-418b-9db3-ce83ca0136dd" released by "_copy_volume_from_snapshot" :: held 6.499s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:11 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Lock "cinder-quobyte-475a25b4-ddd4-4fd0-854e-382db687f743-4b4228e6-3bfc-418b-9db3-ce83ca0136dd" released by "_create_volume_from_snapshot" :: held 6.601s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.630s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.520s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-17647768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c41de95-f89d-4298-9d84-efc2fe356ccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5877a1a2074a289da96e6f697d40f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:52:06Z,use_quota=True,user_id='21f9f8bbd8874f67a96711a8638e05c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:52:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] Creating volume 4c41de95-f89d-4298-9d84-efc2fe356ccf {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:52:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:52:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:52:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:52:11 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:52:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4c41de95-f89d-4298-9d84-efc2fe356ccf 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:11 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-a85a8636-ea1c-474d-8516-2877e5883ffb req-c5882d1d-5b21-45c9-a5d0-d855006bed9d tempest-VolumesSnapshotsTestJSON-397711982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.308s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:11 devstack cinder-volume[88093]: DEBUG cinder.manager [req-a85a8636-ea1c-474d-8516-2877e5883ffb req-c5882d1d-5b21-45c9-a5d0-d855006bed9d tempest-VolumesSnapshotsTestJSON-397711982 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:52:11 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4c41de95-f89d-4298-9d84-efc2fe356ccf 1073741824 Sep 10 19:52:11 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:11 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-a85a8636-ea1c-474d-8516-2877e5883ffb req-c5882d1d-5b21-45c9-a5d0-d855006bed9d tempest-VolumesSnapshotsTestJSON-397711982 None] Deleted volume successfully. Sep 10 19:52:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b34f6e6f-a699-4511-9988-806a6859b2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b4228e6-3bfc-418b-9db3-ce83ca0136dd', 'volume_size': 1, 'snapshot_id': '475a25b4-ddd4-4fd0-854e-382db687f743'}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4feabc53-3bd5-4387-8d63-21f5d9a48c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:11 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-a85a8636-ea1c-474d-8516-2877e5883ffb req-c5882d1d-5b21-45c9-a5d0-d855006bed9d tempest-VolumesSnapshotsTestJSON-397711982 None] Lock "cinder-c75a041a-4d0f-4097-b5f5-c2f6379b2c25-delete_volume" released by "delete_volume" :: held 2.652s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:11 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Volume volume-4b4228e6-3bfc-418b-9db3-ce83ca0136dd (4b4228e6-3bfc-418b-9db3-ce83ca0136dd): created successfully Sep 10 19:52:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4feabc53-3bd5-4387-8d63-21f5d9a48c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Flow 'volume_create_manager' (6721e72f-4c17-4f14-a0e5-475052608081) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:52:11 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-a429a0bd-5273-4c72-85c1-4204fc046233 tempest-VolumeDependencyTests-1461652796 None] Created volume successfully. Sep 10 19:52:12 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4c41de95-f89d-4298-9d84-efc2fe356ccf 1073741824" returned: 0 in 0.624s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4c41de95-f89d-4298-9d84-efc2fe356ccf {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:12 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4c41de95-f89d-4298-9d84-efc2fe356ccf Sep 10 19:52:12 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:12 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4c41de95-f89d-4298-9d84-efc2fe356ccf" returned: 0 in 0.276s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:12 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:52:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8608a162-d5ba-4be0-a455-e1429307d77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c41de95-f89d-4298-9d84-efc2fe356ccf', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac84a5b-5d45-46ca-ad64-2b4afa176995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:12 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] Volume volume-4c41de95-f89d-4298-9d84-efc2fe356ccf (4c41de95-f89d-4298-9d84-efc2fe356ccf): created successfully Sep 10 19:52:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac84a5b-5d45-46ca-ad64-2b4afa176995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] Flow 'volume_create_manager' (616534a6-2384-4ae9-9d15-3c1a48f131a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:52:12 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-e280db24-77e1-4607-bd56-8f0d95208d32 tempest-VolumesTransfersV355Test-1312037848 None] Created volume successfully. Sep 10 19:52:12 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bb8ca609-e874-4625-a953-6c73b8aa8217 tempest-VolumeDependencyTests-1461652796 None] Acquiring lock "cinder-475a25b4-ddd4-4fd0-854e-382db687f743-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:12 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bb8ca609-e874-4625-a953-6c73b8aa8217 tempest-VolumeDependencyTests-1461652796 None] Lock "cinder-475a25b4-ddd4-4fd0-854e-382db687f743-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:12 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bb8ca609-e874-4625-a953-6c73b8aa8217 tempest-VolumeDependencyTests-1461652796 None] Acquiring lock "cinder-quobyte-9b15db20-6923-405c-beb1-618092564ff8" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:12 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bb8ca609-e874-4625-a953-6c73b8aa8217 tempest-VolumeDependencyTests-1461652796 None] Lock "cinder-quobyte-9b15db20-6923-405c-beb1-618092564ff8" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:12 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bb8ca609-e874-4625-a953-6c73b8aa8217 tempest-VolumeDependencyTests-1461652796 None] Acquiring lock "cinder-quobyte-475a25b4-ddd4-4fd0-854e-382db687f743" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:12 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bb8ca609-e874-4625-a953-6c73b8aa8217 tempest-VolumeDependencyTests-1461652796 None] Lock "cinder-quobyte-475a25b4-ddd4-4fd0-854e-382db687f743" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:12 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-bb8ca609-e874-4625-a953-6c73b8aa8217 tempest-VolumeDependencyTests-1461652796 None] Deleting offline snapshot 475a25b4-ddd4-4fd0-854e-382db687f743 of volume 9b15db20-6923-405c-beb1-618092564ff8 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 19:52:12 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-bb8ca609-e874-4625-a953-6c73b8aa8217 tempest-VolumeDependencyTests-1461652796 None] snapshot_file for this snap is: volume-9b15db20-6923-405c-beb1-618092564ff8.475a25b4-ddd4-4fd0-854e-382db687f743 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 19:52:12 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[4774b430-7a9d-4b35-8871-be768a6d95e9]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bb8ca609-e874-4625-a953-6c73b8aa8217 tempest-VolumeDependencyTests-1461652796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8.475a25b4-ddd4-4fd0-854e-382db687f743 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:12 devstack sudo[99228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8.475a25b4-ddd4-4fd0-854e-382db687f743 Sep 10 19:52:12 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:13 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bb8ca609-e874-4625-a953-6c73b8aa8217 tempest-VolumeDependencyTests-1461652796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8.475a25b4-ddd4-4fd0-854e-382db687f743" returned: 0 in 0.416s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:13 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-bb8ca609-e874-4625-a953-6c73b8aa8217 tempest-VolumeDependencyTests-1461652796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b15db20-6923-405c-beb1-618092564ff8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:52:13 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1deacd-2c21-4064-a405-f634e6fd2473]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bb8ca609-e874-4625-a953-6c73b8aa8217 tempest-VolumeDependencyTests-1461652796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:13 devstack sudo[99233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8 Sep 10 19:52:13 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:13 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bb8ca609-e874-4625-a953-6c73b8aa8217 tempest-VolumeDependencyTests-1461652796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8" returned: 0 in 0.622s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bb8ca609-e874-4625-a953-6c73b8aa8217 tempest-VolumeDependencyTests-1461652796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8.475a25b4-ddd4-4fd0-854e-382db687f743 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:13 devstack sudo[99238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8.475a25b4-ddd4-4fd0-854e-382db687f743 Sep 10 19:52:13 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:14 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:52:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] Flow 'volume_create_manager' (36d1b9c6-c0c5-4d43-a36d-0fc23db9a9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:52:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (028bbb37-c1c1-4643-9cc1-493496624f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:14 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bb8ca609-e874-4625-a953-6c73b8aa8217 tempest-VolumeDependencyTests-1461652796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8.475a25b4-ddd4-4fd0-854e-382db687f743" returned: 0 in 0.557s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bb8ca609-e874-4625-a953-6c73b8aa8217 tempest-VolumeDependencyTests-1461652796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8.475a25b4-ddd4-4fd0-854e-382db687f743 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (028bbb37-c1c1-4643-9cc1-493496624f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1486567442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74643f1b-7005-4868-925f-72ce9f8eeb58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a7957a30084d0991f06e4b0cbe414f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:52:14Z,use_quota=True,user_id='40c9b424e47a49cc9a1f575843c28bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d83a97-e07e-4af8-a2a4-186fa18814de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:14 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8.475a25b4-ddd4-4fd0-854e-382db687f743 Sep 10 19:52:14 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d83a97-e07e-4af8-a2a4-186fa18814de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0ea082-ea4d-4c47-9c7c-9092d13c9183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0ea082-ea4d-4c47-9c7c-9092d13c9183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74643f1b-7005-4868-925f-72ce9f8eeb58', 'volume_name': 'volume-74643f1b-7005-4868-925f-72ce9f8eeb58', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b730c3dd-3d63-4d3d-b220-4f355b0e8420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b730c3dd-3d63-4d3d-b220-4f355b0e8420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792c6865-0b13-49d3-aa1d-ab8d04d6c08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:14 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] Volume 74643f1b-7005-4868-925f-72ce9f8eeb58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74643f1b-7005-4868-925f-72ce9f8eeb58', 'volume_size': 1} Sep 10 19:52:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1486567442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74643f1b-7005-4868-925f-72ce9f8eeb58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a7957a30084d0991f06e4b0cbe414f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:52:14Z,use_quota=True,user_id='40c9b424e47a49cc9a1f575843c28bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:52:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] Creating volume 74643f1b-7005-4868-925f-72ce9f8eeb58 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:52:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:52:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:52:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:52:14 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:52:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:14 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58 1073741824 Sep 10 19:52:14 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:14 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-c5928312-4a1d-4e2e-998e-03d15087feba tempest-VolumesTransfersV355Test-1541418823 None] Transfer volume completed successfully. Sep 10 19:52:14 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bb8ca609-e874-4625-a953-6c73b8aa8217 tempest-VolumeDependencyTests-1461652796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8.475a25b4-ddd4-4fd0-854e-382db687f743" returned: 0 in 0.344s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bb8ca609-e874-4625-a953-6c73b8aa8217 tempest-VolumeDependencyTests-1461652796 None] Lock "cinder-quobyte-475a25b4-ddd4-4fd0-854e-382db687f743" released by "_delete_snapshot" :: held 2.066s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bb8ca609-e874-4625-a953-6c73b8aa8217 tempest-VolumeDependencyTests-1461652796 None] Lock "cinder-quobyte-9b15db20-6923-405c-beb1-618092564ff8" released by "delete_snapshot" :: held 2.098s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:14 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-bb8ca609-e874-4625-a953-6c73b8aa8217 tempest-VolumeDependencyTests-1461652796 None] Created reservations ['891e4278-71a2-43fa-a41b-d1a39a6ec7b6', 'ee19fea5-3474-49bc-85d4-5bb611b19dec', '34f4cb93-e357-4292-9861-cadd7f486cf1', '91f5b6de-f34b-4931-82a8-dd64fe7786d9'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:52:14 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-bb8ca609-e874-4625-a953-6c73b8aa8217 tempest-VolumeDependencyTests-1461652796 None] Delete snapshot completed successfully. Sep 10 19:52:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bb8ca609-e874-4625-a953-6c73b8aa8217 tempest-VolumeDependencyTests-1461652796 None] Lock "cinder-475a25b4-ddd4-4fd0-854e-382db687f743-delete_snapshot" released by "delete_snapshot" :: held 2.323s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0383ebed-9750-42a3-9189-34a8bce24b25 tempest-VolumeDependencyTests-1461652796 None] Acquiring lock "cinder-9b15db20-6923-405c-beb1-618092564ff8-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:15 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58 1073741824" returned: 0 in 0.651s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0383ebed-9750-42a3-9189-34a8bce24b25 tempest-VolumeDependencyTests-1461652796 None] Lock "cinder-9b15db20-6923-405c-beb1-618092564ff8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0383ebed-9750-42a3-9189-34a8bce24b25 tempest-VolumeDependencyTests-1461652796 None] Acquiring lock "cinder-quobyte-9b15db20-6923-405c-beb1-618092564ff8" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:15 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58 Sep 10 19:52:15 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0383ebed-9750-42a3-9189-34a8bce24b25 tempest-VolumeDependencyTests-1461652796 None] Lock "cinder-quobyte-9b15db20-6923-405c-beb1-618092564ff8" acquired by "delete_volume" :: waited 0.027s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:15 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[6871cbc4-2465-4f05-9777-c31b6f1c4491]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0383ebed-9750-42a3-9189-34a8bce24b25 tempest-VolumeDependencyTests-1461652796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:15 devstack sudo[99254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8 Sep 10 19:52:15 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:15 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58" returned: 0 in 0.300s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:15 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:52:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792c6865-0b13-49d3-aa1d-ab8d04d6c08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74643f1b-7005-4868-925f-72ce9f8eeb58', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a57440e5-665d-48f8-a630-f564e422302b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:15 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] Volume volume-74643f1b-7005-4868-925f-72ce9f8eeb58 (74643f1b-7005-4868-925f-72ce9f8eeb58): created successfully Sep 10 19:52:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a57440e5-665d-48f8-a630-f564e422302b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] Flow 'volume_create_manager' (36d1b9c6-c0c5-4d43-a36d-0fc23db9a9ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:52:15 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-7ba528aa-407f-4623-9a61-d8b479993f93 tempest-VolumesDeleteCascade-2066102729 None] Created volume successfully. Sep 10 19:52:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bf1727b0-709a-4900-a16a-926cef7e6074 tempest-VolumesTransfersV355Test-46748396 None] Acquiring lock "cinder-4c41de95-f89d-4298-9d84-efc2fe356ccf-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bf1727b0-709a-4900-a16a-926cef7e6074 tempest-VolumesTransfersV355Test-46748396 None] Lock "cinder-4c41de95-f89d-4298-9d84-efc2fe356ccf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bf1727b0-709a-4900-a16a-926cef7e6074 tempest-VolumesTransfersV355Test-46748396 None] Acquiring lock "cinder-quobyte-4c41de95-f89d-4298-9d84-efc2fe356ccf" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bf1727b0-709a-4900-a16a-926cef7e6074 tempest-VolumesTransfersV355Test-46748396 None] Lock "cinder-quobyte-4c41de95-f89d-4298-9d84-efc2fe356ccf" acquired by "delete_volume" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:15 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[90943150-a178-4101-bb1a-6a9f4b15c443]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bf1727b0-709a-4900-a16a-926cef7e6074 tempest-VolumesTransfersV355Test-46748396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4c41de95-f89d-4298-9d84-efc2fe356ccf {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:15 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0383ebed-9750-42a3-9189-34a8bce24b25 tempest-VolumeDependencyTests-1461652796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8" returned: 0 in 0.454s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0383ebed-9750-42a3-9189-34a8bce24b25 tempest-VolumeDependencyTests-1461652796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:15 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8 Sep 10 19:52:15 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:15 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4c41de95-f89d-4298-9d84-efc2fe356ccf Sep 10 19:52:15 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:15 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0383ebed-9750-42a3-9189-34a8bce24b25 tempest-VolumeDependencyTests-1461652796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9b15db20-6923-405c-beb1-618092564ff8" returned: 0 in 0.280s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0383ebed-9750-42a3-9189-34a8bce24b25 tempest-VolumeDependencyTests-1461652796 None] Lock "cinder-quobyte-9b15db20-6923-405c-beb1-618092564ff8" released by "delete_volume" :: held 0.815s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:16 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bf1727b0-709a-4900-a16a-926cef7e6074 tempest-VolumesTransfersV355Test-46748396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4c41de95-f89d-4298-9d84-efc2fe356ccf" returned: 0 in 0.430s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bf1727b0-709a-4900-a16a-926cef7e6074 tempest-VolumesTransfersV355Test-46748396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4c41de95-f89d-4298-9d84-efc2fe356ccf {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-0383ebed-9750-42a3-9189-34a8bce24b25 tempest-VolumeDependencyTests-1461652796 None] Created reservations ['a78c846b-175b-43e0-84e2-94b0eca88b2c', '02b3fb24-3d65-44bf-b900-2e90faca8d92', '6a4eb122-2d94-4a1e-904b-1f1280ce69a3', '3c51e050-b620-4d53-8a6d-c72f7c515682'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:52:16 devstack sudo[99268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4c41de95-f89d-4298-9d84-efc2fe356ccf Sep 10 19:52:16 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0383ebed-9750-42a3-9189-34a8bce24b25 tempest-VolumeDependencyTests-1461652796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0383ebed-9750-42a3-9189-34a8bce24b25 tempest-VolumeDependencyTests-1461652796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0383ebed-9750-42a3-9189-34a8bce24b25 tempest-VolumeDependencyTests-1461652796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0383ebed-9750-42a3-9189-34a8bce24b25 tempest-VolumeDependencyTests-1461652796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0383ebed-9750-42a3-9189-34a8bce24b25 tempest-VolumeDependencyTests-1461652796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0383ebed-9750-42a3-9189-34a8bce24b25 tempest-VolumeDependencyTests-1461652796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:16 devstack sudo[99270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:52:16 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d10b36c7-8a82-4464-b5b9-10201b04a14a tempest-VolumeDependencyTests-1461652796 None] Acquiring lock "cinder-4b4228e6-3bfc-418b-9db3-ce83ca0136dd-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d10b36c7-8a82-4464-b5b9-10201b04a14a tempest-VolumeDependencyTests-1461652796 None] Lock "cinder-4b4228e6-3bfc-418b-9db3-ce83ca0136dd-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d10b36c7-8a82-4464-b5b9-10201b04a14a tempest-VolumeDependencyTests-1461652796 None] Acquiring lock "cinder-quobyte-4b4228e6-3bfc-418b-9db3-ce83ca0136dd" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d10b36c7-8a82-4464-b5b9-10201b04a14a tempest-VolumeDependencyTests-1461652796 None] Lock "cinder-quobyte-4b4228e6-3bfc-418b-9db3-ce83ca0136dd" acquired by "delete_volume" :: waited 0.027s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:16 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bf1727b0-709a-4900-a16a-926cef7e6074 tempest-VolumesTransfersV355Test-46748396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4c41de95-f89d-4298-9d84-efc2fe356ccf" returned: 0 in 0.446s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec72e8e-dc1f-4641-a76a-2805d38b62cc]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d10b36c7-8a82-4464-b5b9-10201b04a14a tempest-VolumeDependencyTests-1461652796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4b4228e6-3bfc-418b-9db3-ce83ca0136dd {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bf1727b0-709a-4900-a16a-926cef7e6074 tempest-VolumesTransfersV355Test-46748396 None] Lock "cinder-quobyte-4c41de95-f89d-4298-9d84-efc2fe356ccf" released by "delete_volume" :: held 0.936s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:16 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0383ebed-9750-42a3-9189-34a8bce24b25 tempest-VolumeDependencyTests-1461652796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.416s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-0383ebed-9750-42a3-9189-34a8bce24b25 tempest-VolumeDependencyTests-1461652796 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:52:16 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-0383ebed-9750-42a3-9189-34a8bce24b25 tempest-VolumeDependencyTests-1461652796 None] Deleted volume successfully. Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0383ebed-9750-42a3-9189-34a8bce24b25 tempest-VolumeDependencyTests-1461652796 None] Lock "cinder-9b15db20-6923-405c-beb1-618092564ff8-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-bf1727b0-709a-4900-a16a-926cef7e6074 tempest-VolumesTransfersV355Test-46748396 None] Created reservations ['0c415e81-a319-4f9c-95cc-56d8380bb386', '93b33204-6c8b-4c63-b6d9-a27c7bd2aa77', '6e4772ea-4500-47ca-89db-50c8586b3cf2', '0c5c8032-54e2-4cfc-8fbb-c189761c1aa6'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:52:16 devstack sudo[99274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4b4228e6-3bfc-418b-9db3-ce83ca0136dd Sep 10 19:52:16 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ea165a75-e37b-4b13-ae71-4b80b8a5d204 tempest-VolumesDeleteCascade-2066102729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ea165a75-e37b-4b13-ae71-4b80b8a5d204 tempest-VolumesDeleteCascade-2066102729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-bf1727b0-709a-4900-a16a-926cef7e6074 tempest-VolumesTransfersV355Test-46748396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-bf1727b0-709a-4900-a16a-926cef7e6074 tempest-VolumesTransfersV355Test-46748396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-bf1727b0-709a-4900-a16a-926cef7e6074 tempest-VolumesTransfersV355Test-46748396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-bf1727b0-709a-4900-a16a-926cef7e6074 tempest-VolumesTransfersV355Test-46748396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-bf1727b0-709a-4900-a16a-926cef7e6074 tempest-VolumesTransfersV355Test-46748396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bf1727b0-709a-4900-a16a-926cef7e6074 tempest-VolumesTransfersV355Test-46748396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-ea165a75-e37b-4b13-ae71-4b80b8a5d204 tempest-VolumesDeleteCascade-2066102729 None] Creating offline snapshot 6e3075f1-4c96-43e6-80f6-78f472c637fb of volume 74643f1b-7005-4868-925f-72ce9f8eeb58 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 19:52:16 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:52:16 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[480d17ed-0b57-4ea2-b30d-06106af01737]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ea165a75-e37b-4b13-ae71-4b80b8a5d204 tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:16 devstack sudo[99278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58 Sep 10 19:52:16 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:16 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d10b36c7-8a82-4464-b5b9-10201b04a14a tempest-VolumeDependencyTests-1461652796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4b4228e6-3bfc-418b-9db3-ce83ca0136dd" returned: 0 in 0.508s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d10b36c7-8a82-4464-b5b9-10201b04a14a tempest-VolumeDependencyTests-1461652796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4b4228e6-3bfc-418b-9db3-ce83ca0136dd {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:17 devstack sudo[99284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4b4228e6-3bfc-418b-9db3-ce83ca0136dd Sep 10 19:52:17 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:17 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bf1727b0-709a-4900-a16a-926cef7e6074 tempest-VolumesTransfersV355Test-46748396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.286s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:17 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-bf1727b0-709a-4900-a16a-926cef7e6074 tempest-VolumesTransfersV355Test-46748396 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:52:17 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-bf1727b0-709a-4900-a16a-926cef7e6074 tempest-VolumesTransfersV355Test-46748396 None] Deleted volume successfully. Sep 10 19:52:17 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bf1727b0-709a-4900-a16a-926cef7e6074 tempest-VolumesTransfersV355Test-46748396 None] Lock "cinder-4c41de95-f89d-4298-9d84-efc2fe356ccf-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:17 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:17 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9d422bd4-caa1-4063-94d4-eada2b537d2c tempest-BackendsCapabilitiesAdminTestsJSON-1685217791 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.2748527526855, 'free_capacity_gb': 1773.2748527526855, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88093) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 10 19:52:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d10b36c7-8a82-4464-b5b9-10201b04a14a tempest-VolumeDependencyTests-1461652796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4b4228e6-3bfc-418b-9db3-ce83ca0136dd" returned: 0 in 0.307s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:17 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ea165a75-e37b-4b13-ae71-4b80b8a5d204 tempest-VolumesDeleteCascade-2066102729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58" returned: 0 in 0.486s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ea165a75-e37b-4b13-ae71-4b80b8a5d204 tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:17 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d10b36c7-8a82-4464-b5b9-10201b04a14a tempest-VolumeDependencyTests-1461652796 None] Lock "cinder-quobyte-4b4228e6-3bfc-418b-9db3-ce83ca0136dd" released by "delete_volume" :: held 0.903s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:17 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb 1G Sep 10 19:52:17 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:17 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f29c5b36-a786-4bb8-ae76-06d1695d4404 tempest-BackendsCapabilitiesAdminTestsJSON-1685217791 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.2748527526855, 'free_capacity_gb': 1773.2748527526855, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88093) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 10 19:52:17 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-d10b36c7-8a82-4464-b5b9-10201b04a14a tempest-VolumeDependencyTests-1461652796 None] Created reservations ['27d065cb-7bd4-4f2b-b37e-63e8f4ed8313', '0ceab7f7-fec7-422d-b2a4-80913c9a47d3', '32be9d37-06bb-4fa6-b395-6f0057e22210', '745df9a0-8f75-4790-b581-0d2ac8159fe0'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:52:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d10b36c7-8a82-4464-b5b9-10201b04a14a tempest-VolumeDependencyTests-1461652796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d10b36c7-8a82-4464-b5b9-10201b04a14a tempest-VolumeDependencyTests-1461652796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:17 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d10b36c7-8a82-4464-b5b9-10201b04a14a tempest-VolumeDependencyTests-1461652796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:52:17 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d10b36c7-8a82-4464-b5b9-10201b04a14a tempest-VolumeDependencyTests-1461652796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:52:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d10b36c7-8a82-4464-b5b9-10201b04a14a tempest-VolumeDependencyTests-1461652796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d10b36c7-8a82-4464-b5b9-10201b04a14a tempest-VolumeDependencyTests-1461652796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:17 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:52:17 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:17 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ea165a75-e37b-4b13-ae71-4b80b8a5d204 tempest-VolumesDeleteCascade-2066102729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb 1G" returned: 0 in 0.545s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ea165a75-e37b-4b13-ae71-4b80b8a5d204 tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74643f1b-7005-4868-925f-72ce9f8eeb58 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:17 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d10b36c7-8a82-4464-b5b9-10201b04a14a tempest-VolumeDependencyTests-1461652796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.377s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:17 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-d10b36c7-8a82-4464-b5b9-10201b04a14a tempest-VolumeDependencyTests-1461652796 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:52:17 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74643f1b-7005-4868-925f-72ce9f8eeb58 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb Sep 10 19:52:17 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:17 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-d10b36c7-8a82-4464-b5b9-10201b04a14a tempest-VolumeDependencyTests-1461652796 None] Deleted volume successfully. Sep 10 19:52:17 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d10b36c7-8a82-4464-b5b9-10201b04a14a tempest-VolumeDependencyTests-1461652796 None] Lock "cinder-4b4228e6-3bfc-418b-9db3-ce83ca0136dd-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:18 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ea165a75-e37b-4b13-ae71-4b80b8a5d204 tempest-VolumesDeleteCascade-2066102729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74643f1b-7005-4868-925f-72ce9f8eeb58 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb" returned: 0 in 0.464s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:18 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-ea165a75-e37b-4b13-ae71-4b80b8a5d204 tempest-VolumesDeleteCascade-2066102729 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb is being set with open permissions: ugo+rw Sep 10 19:52:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ea165a75-e37b-4b13-ae71-4b80b8a5d204 tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:18 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb Sep 10 19:52:18 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:18 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:52:18 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] Flow 'volume_create_manager' (ec48bcd3-ce39-47c9-9f1f-2c4550fb386c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:52:18 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3212353e-674d-4d3e-8c98-236bb624adf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:18 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3212353e-674d-4d3e-8c98-236bb624adf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-9032397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25cc5cdc-e3e3-40e3-a837-09f2710bb9db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5877a1a2074a289da96e6f697d40f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:52:19Z,use_quota=True,user_id='21f9f8bbd8874f67a96711a8638e05c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:18 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f61ccfe-d6fc-4cf5-ac6a-4cf75d0d03e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:18 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:18 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f61ccfe-d6fc-4cf5-ac6a-4cf75d0d03e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:18 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c22aa6-a890-4eba-b092-640dc677e0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:18 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c22aa6-a890-4eba-b092-640dc677e0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25cc5cdc-e3e3-40e3-a837-09f2710bb9db', 'volume_name': 'volume-25cc5cdc-e3e3-40e3-a837-09f2710bb9db', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:18 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (654907ae-e73c-4294-8426-c3de025d6f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:18 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (654907ae-e73c-4294-8426-c3de025d6f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:18 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f839a315-921e-4ff5-9e00-3fcad8360847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:18 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] Volume 25cc5cdc-e3e3-40e3-a837-09f2710bb9db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25cc5cdc-e3e3-40e3-a837-09f2710bb9db', 'volume_size': 1} Sep 10 19:52:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ea165a75-e37b-4b13-ae71-4b80b8a5d204 tempest-VolumesDeleteCascade-2066102729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb" returned: 0 in 0.409s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ea165a75-e37b-4b13-ae71-4b80b8a5d204 tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:18 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.info Sep 10 19:52:18 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:19 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ea165a75-e37b-4b13-ae71-4b80b8a5d204 tempest-VolumesDeleteCascade-2066102729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.info" returned: 0 in 0.289s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:19 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-ea165a75-e37b-4b13-ae71-4b80b8a5d204 tempest-VolumesDeleteCascade-2066102729 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.info is being set with open permissions: ugo+rw Sep 10 19:52:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ea165a75-e37b-4b13-ae71-4b80b8a5d204 tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:19 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.info Sep 10 19:52:19 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:19 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ea165a75-e37b-4b13-ae71-4b80b8a5d204 tempest-VolumesDeleteCascade-2066102729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.info" returned: 0 in 0.290s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ea165a75-e37b-4b13-ae71-4b80b8a5d204 tempest-VolumesDeleteCascade-2066102729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.644s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.658s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:19 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-9032397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25cc5cdc-e3e3-40e3-a837-09f2710bb9db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5877a1a2074a289da96e6f697d40f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:52:19Z,use_quota=True,user_id='21f9f8bbd8874f67a96711a8638e05c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:52:19 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] Creating volume 25cc5cdc-e3e3-40e3-a837-09f2710bb9db {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:52:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:19 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:52:19 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:52:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:19 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:52:19 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:52:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25cc5cdc-e3e3-40e3-a837-09f2710bb9db 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:19 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25cc5cdc-e3e3-40e3-a837-09f2710bb9db 1073741824 Sep 10 19:52:19 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:19 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-ea165a75-e37b-4b13-ae71-4b80b8a5d204 tempest-VolumesDeleteCascade-2066102729 None] Create snapshot completed successfully Sep 10 19:52:20 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25cc5cdc-e3e3-40e3-a837-09f2710bb9db 1073741824" returned: 0 in 0.619s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25cc5cdc-e3e3-40e3-a837-09f2710bb9db {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:20 devstack sudo[99321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25cc5cdc-e3e3-40e3-a837-09f2710bb9db Sep 10 19:52:20 devstack sudo[99321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a28897a1-82b4-4de4-af32-795f82715c6d tempest-VolumesDeleteCascade-2066102729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:20 devstack sudo[99321]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25cc5cdc-e3e3-40e3-a837-09f2710bb9db" returned: 0 in 0.304s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:20 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:52:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a28897a1-82b4-4de4-af32-795f82715c6d tempest-VolumesDeleteCascade-2066102729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.254s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:20 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f839a315-921e-4ff5-9e00-3fcad8360847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25cc5cdc-e3e3-40e3-a837-09f2710bb9db', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:20 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e9b4869-2cb4-4496-ae4c-d10c3c020bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:20 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-a28897a1-82b4-4de4-af32-795f82715c6d tempest-VolumesDeleteCascade-2066102729 None] Creating offline snapshot 687a1a70-3d03-4618-ae5e-52361165b32e of volume 74643f1b-7005-4868-925f-72ce9f8eeb58 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 19:52:20 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] Volume volume-25cc5cdc-e3e3-40e3-a837-09f2710bb9db (25cc5cdc-e3e3-40e3-a837-09f2710bb9db): created successfully Sep 10 19:52:20 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e9b4869-2cb4-4496-ae4c-d10c3c020bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:20 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] Flow 'volume_create_manager' (ec48bcd3-ce39-47c9-9f1f-2c4550fb386c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:52:20 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c34356-45ea-4796-a079-462422afca45]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a28897a1-82b4-4de4-af32-795f82715c6d tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:20 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-c2d8ce9b-8909-4cc1-9288-79a76c144c28 tempest-VolumesTransfersV355Test-1312037848 None] Created volume successfully. Sep 10 19:52:20 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb Sep 10 19:52:20 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:21 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a28897a1-82b4-4de4-af32-795f82715c6d tempest-VolumesDeleteCascade-2066102729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb" returned: 0 in 0.542s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:21 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-a28897a1-82b4-4de4-af32-795f82715c6d tempest-VolumesDeleteCascade-2066102729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74643f1b-7005-4868-925f-72ce9f8eeb58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:52:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a28897a1-82b4-4de4-af32-795f82715c6d tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.687a1a70-3d03-4618-ae5e-52361165b32e 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:21 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e8402876-f749-4047-bde9-5efd4804f45a tempest-VolumesTransfersV355Test-46748396 None] Acquiring lock "cinder-25cc5cdc-e3e3-40e3-a837-09f2710bb9db-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:21 devstack sudo[99332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.687a1a70-3d03-4618-ae5e-52361165b32e 1G Sep 10 19:52:21 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e8402876-f749-4047-bde9-5efd4804f45a tempest-VolumesTransfersV355Test-46748396 None] Lock "cinder-25cc5cdc-e3e3-40e3-a837-09f2710bb9db-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:21 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:21 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e8402876-f749-4047-bde9-5efd4804f45a tempest-VolumesTransfersV355Test-46748396 None] Acquiring lock "cinder-quobyte-25cc5cdc-e3e3-40e3-a837-09f2710bb9db" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:21 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e8402876-f749-4047-bde9-5efd4804f45a tempest-VolumesTransfersV355Test-46748396 None] Lock "cinder-quobyte-25cc5cdc-e3e3-40e3-a837-09f2710bb9db" acquired by "delete_volume" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:21 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[034aefc7-0aef-4b8d-97d5-ac30325f937e]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e8402876-f749-4047-bde9-5efd4804f45a tempest-VolumesTransfersV355Test-46748396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25cc5cdc-e3e3-40e3-a837-09f2710bb9db {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:21 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25cc5cdc-e3e3-40e3-a837-09f2710bb9db Sep 10 19:52:21 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:21 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a28897a1-82b4-4de4-af32-795f82715c6d tempest-VolumesDeleteCascade-2066102729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.687a1a70-3d03-4618-ae5e-52361165b32e 1G" returned: 0 in 0.588s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a28897a1-82b4-4de4-af32-795f82715c6d tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.687a1a70-3d03-4618-ae5e-52361165b32e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:21 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.687a1a70-3d03-4618-ae5e-52361165b32e Sep 10 19:52:21 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:21 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e8402876-f749-4047-bde9-5efd4804f45a tempest-VolumesTransfersV355Test-46748396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25cc5cdc-e3e3-40e3-a837-09f2710bb9db" returned: 0 in 0.578s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e8402876-f749-4047-bde9-5efd4804f45a tempest-VolumesTransfersV355Test-46748396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25cc5cdc-e3e3-40e3-a837-09f2710bb9db {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:21 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25cc5cdc-e3e3-40e3-a837-09f2710bb9db Sep 10 19:52:21 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:22 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a28897a1-82b4-4de4-af32-795f82715c6d tempest-VolumesDeleteCascade-2066102729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.687a1a70-3d03-4618-ae5e-52361165b32e" returned: 0 in 0.393s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:22 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-a28897a1-82b4-4de4-af32-795f82715c6d tempest-VolumesDeleteCascade-2066102729 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.687a1a70-3d03-4618-ae5e-52361165b32e is being set with open permissions: ugo+rw Sep 10 19:52:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a28897a1-82b4-4de4-af32-795f82715c6d tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.687a1a70-3d03-4618-ae5e-52361165b32e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:22 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.687a1a70-3d03-4618-ae5e-52361165b32e Sep 10 19:52:22 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:22 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e8402876-f749-4047-bde9-5efd4804f45a tempest-VolumesTransfersV355Test-46748396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25cc5cdc-e3e3-40e3-a837-09f2710bb9db" returned: 0 in 0.368s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:22 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e8402876-f749-4047-bde9-5efd4804f45a tempest-VolumesTransfersV355Test-46748396 None] Lock "cinder-quobyte-25cc5cdc-e3e3-40e3-a837-09f2710bb9db" released by "delete_volume" :: held 1.015s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:22 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-e8402876-f749-4047-bde9-5efd4804f45a tempest-VolumesTransfersV355Test-46748396 None] Created reservations ['5e11a47e-e46e-4f1a-ab0d-0c5f528e5573', '0055489b-1e50-4a51-a537-5196613eb992', 'cfca9e8c-1e8e-46ce-b212-52f375f1562b', '29755015-ce3d-4d82-9a70-5a42a745ef6f'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:52:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e8402876-f749-4047-bde9-5efd4804f45a tempest-VolumesTransfersV355Test-46748396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e8402876-f749-4047-bde9-5efd4804f45a tempest-VolumesTransfersV355Test-46748396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:22 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e8402876-f749-4047-bde9-5efd4804f45a tempest-VolumesTransfersV355Test-46748396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:52:22 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e8402876-f749-4047-bde9-5efd4804f45a tempest-VolumesTransfersV355Test-46748396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:52:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e8402876-f749-4047-bde9-5efd4804f45a tempest-VolumesTransfersV355Test-46748396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e8402876-f749-4047-bde9-5efd4804f45a tempest-VolumesTransfersV355Test-46748396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:22 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a28897a1-82b4-4de4-af32-795f82715c6d tempest-VolumesDeleteCascade-2066102729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.687a1a70-3d03-4618-ae5e-52361165b32e" returned: 0 in 0.353s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:22 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:52:22 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a28897a1-82b4-4de4-af32-795f82715c6d tempest-VolumesDeleteCascade-2066102729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.035s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:22 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-a28897a1-82b4-4de4-af32-795f82715c6d tempest-VolumesDeleteCascade-2066102729 None] Create snapshot completed successfully Sep 10 19:52:22 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e8402876-f749-4047-bde9-5efd4804f45a tempest-VolumesTransfersV355Test-46748396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.300s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:22 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-e8402876-f749-4047-bde9-5efd4804f45a tempest-VolumesTransfersV355Test-46748396 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:52:22 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-e8402876-f749-4047-bde9-5efd4804f45a tempest-VolumesTransfersV355Test-46748396 None] Deleted volume successfully. Sep 10 19:52:22 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e8402876-f749-4047-bde9-5efd4804f45a tempest-VolumesTransfersV355Test-46748396 None] Lock "cinder-25cc5cdc-e3e3-40e3-a837-09f2710bb9db-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:23 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Acquiring lock "cinder-74643f1b-7005-4868-925f-72ce9f8eeb58-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:23 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-74643f1b-7005-4868-925f-72ce9f8eeb58-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:23 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Performing cascade delete. {{(pid=88093) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 10 19:52:23 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Acquiring lock "cinder-687a1a70-3d03-4618-ae5e-52361165b32e-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:23 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-687a1a70-3d03-4618-ae5e-52361165b32e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:23 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Acquiring lock "cinder-quobyte-74643f1b-7005-4868-925f-72ce9f8eeb58" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:23 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-quobyte-74643f1b-7005-4868-925f-72ce9f8eeb58" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:23 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Acquiring lock "cinder-quobyte-687a1a70-3d03-4618-ae5e-52361165b32e" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:23 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-quobyte-687a1a70-3d03-4618-ae5e-52361165b32e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:23 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Deleting offline snapshot 687a1a70-3d03-4618-ae5e-52361165b32e of volume 74643f1b-7005-4868-925f-72ce9f8eeb58 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 19:52:23 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] snapshot_file for this snap is: volume-74643f1b-7005-4868-925f-72ce9f8eeb58.687a1a70-3d03-4618-ae5e-52361165b32e {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 19:52:23 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[5094ccd8-50cd-45dd-ab86-6339cbb911f3]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.687a1a70-3d03-4618-ae5e-52361165b32e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:23 devstack sudo[99357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.687a1a70-3d03-4618-ae5e-52361165b32e Sep 10 19:52:23 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:24 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.687a1a70-3d03-4618-ae5e-52361165b32e" returned: 0 in 0.408s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:24 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74643f1b-7005-4868-925f-72ce9f8eeb58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:52:24 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c49449d-482e-43bb-8ebf-6e95b804e0d2]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:24 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb Sep 10 19:52:24 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:24 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb" returned: 0 in 0.375s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:24 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74643f1b-7005-4868-925f-72ce9f8eeb58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:52:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.687a1a70-3d03-4618-ae5e-52361165b32e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:24 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.687a1a70-3d03-4618-ae5e-52361165b32e Sep 10 19:52:24 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:25 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.687a1a70-3d03-4618-ae5e-52361165b32e" returned: 0 in 0.491s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.687a1a70-3d03-4618-ae5e-52361165b32e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:25 devstack sudo[99372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.687a1a70-3d03-4618-ae5e-52361165b32e Sep 10 19:52:25 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:25 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.687a1a70-3d03-4618-ae5e-52361165b32e" returned: 0 in 0.381s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:25 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-quobyte-687a1a70-3d03-4618-ae5e-52361165b32e" released by "_delete_snapshot" :: held 1.786s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:25 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-quobyte-74643f1b-7005-4868-925f-72ce9f8eeb58" released by "delete_snapshot" :: held 1.824s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:25 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Created reservations ['ec419a68-95be-4220-a138-41d755f38bd1', 'cf5e955f-dd99-4a40-9294-2f639b368de7', 'ef02f01f-b77c-4a15-a934-88f78a06de46', '11fa337a-09af-4f02-8a60-524618ba0be4'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:52:25 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Delete snapshot completed successfully. Sep 10 19:52:25 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-687a1a70-3d03-4618-ae5e-52361165b32e-delete_snapshot" released by "delete_snapshot" :: held 2.055s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:25 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Acquiring lock "cinder-6e3075f1-4c96-43e6-80f6-78f472c637fb-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:25 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-6e3075f1-4c96-43e6-80f6-78f472c637fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:25 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Acquiring lock "cinder-quobyte-74643f1b-7005-4868-925f-72ce9f8eeb58" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:25 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-quobyte-74643f1b-7005-4868-925f-72ce9f8eeb58" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:25 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Acquiring lock "cinder-quobyte-6e3075f1-4c96-43e6-80f6-78f472c637fb" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:25 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-quobyte-6e3075f1-4c96-43e6-80f6-78f472c637fb" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:25 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Deleting offline snapshot 6e3075f1-4c96-43e6-80f6-78f472c637fb of volume 74643f1b-7005-4868-925f-72ce9f8eeb58 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 19:52:25 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] snapshot_file for this snap is: volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 19:52:25 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[f943c0c9-4d7d-4b51-8292-e1cefcb4c84b]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:26 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb Sep 10 19:52:26 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:26 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-f7fa4ab3-c050-425a-b6d5-2b19f6ce4a29 tempest-GroupSnapshotsV319Test-620001504 None] Group tempest-GroupSnapshotsV319Test-Group-1500722415: creating Sep 10 19:52:26 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-f7fa4ab3-c050-425a-b6d5-2b19f6ce4a29 tempest-GroupSnapshotsV319Test-620001504 None] Group tempest-GroupSnapshotsV319Test-Group-1500722415: created successfully Sep 10 19:52:26 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-f7fa4ab3-c050-425a-b6d5-2b19f6ce4a29 tempest-GroupSnapshotsV319Test-620001504 None] Create group completed successfully. Sep 10 19:52:26 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb" returned: 0 in 0.528s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:26 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74643f1b-7005-4868-925f-72ce9f8eeb58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:52:26 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[50510204-8d46-4298-a53a-9b1c307ccf98]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:26 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58 Sep 10 19:52:26 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:26 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58" returned: 0 in 0.427s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:26 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb Sep 10 19:52:26 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:27 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb" returned: 0 in 0.411s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:27 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb Sep 10 19:52:27 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:27 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58.6e3075f1-4c96-43e6-80f6-78f472c637fb" returned: 0 in 0.354s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:27 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-quobyte-6e3075f1-4c96-43e6-80f6-78f472c637fb" released by "_delete_snapshot" :: held 1.867s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:27 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-quobyte-74643f1b-7005-4868-925f-72ce9f8eeb58" released by "delete_snapshot" :: held 1.905s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:27 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Created reservations ['87a0f145-1c51-46a4-b373-1aafa98d0047', 'dd1b61d1-91ff-456f-bc72-ae9dee3be246', '6e8d6b99-a1ac-4396-a15f-83fe7014582c', 'ac6dbeec-9b9b-40bc-885f-3d00714d97ce'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:52:27 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Delete snapshot completed successfully. Sep 10 19:52:27 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-6e3075f1-4c96-43e6-80f6-78f472c637fb-delete_snapshot" released by "delete_snapshot" :: held 2.250s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Snapshots deleted, issuing volume delete {{(pid=88093) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 10 19:52:27 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Acquiring lock "cinder-quobyte-74643f1b-7005-4868-925f-72ce9f8eeb58" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:27 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-quobyte-74643f1b-7005-4868-925f-72ce9f8eeb58" acquired by "delete_volume" :: waited 0.026s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:28 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc61a36-e431-4fa2-9b09-f4d9ad6f1004]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:28 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:52:28 devstack sudo[99395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58 Sep 10 19:52:28 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] Flow 'volume_create_manager' (61e5a43a-80e2-406e-9a3a-1f0b6bdf2174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:52:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d9c460-b97f-40b3-9f80-9adfb806661f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d9c460-b97f-40b3-9f80-9adfb806661f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-721138942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=999b3211-4789-432f-bb3f-0346878cb042,host='devstack@QuobyteHD#QuobyteHD',id=c5dfd826-dbc6-423b-9f8d-f762a29c56ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ae693ae48b474f92585f9669e6b4eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:52:28Z,use_quota=True,user_id='7f9f5e7292bd41329b45a3b5bf64ad4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b363a55-0292-4b2e-9d34-2c684b90d510),volume_type_id=8b363a55-0292-4b2e-9d34-2c684b90d510)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8579ded-41a0-4b55-8468-b7ce1eda55db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8579ded-41a0-4b55-8468-b7ce1eda55db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40267292-0c5d-49cb-a399-adff7b98f518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40267292-0c5d-49cb-a399-adff7b98f518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5dfd826-dbc6-423b-9f8d-f762a29c56ad', 'volume_name': 'volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a85a5cb-038c-4321-ad8a-6f1195f9b96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a85a5cb-038c-4321-ad8a-6f1195f9b96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a08ac92-87b9-4eaf-98eb-a93efd9e3f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:28 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] Volume c5dfd826-dbc6-423b-9f8d-f762a29c56ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad', 'volume_size': 1} Sep 10 19:52:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=999b3211-4789-432f-bb3f-0346878cb042,created_at=2026-09-10T17:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-721138942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=999b3211-4789-432f-bb3f-0346878cb042,host='devstack@QuobyteHD#QuobyteHD',id=c5dfd826-dbc6-423b-9f8d-f762a29c56ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ae693ae48b474f92585f9669e6b4eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:52:28Z,use_quota=True,user_id='7f9f5e7292bd41329b45a3b5bf64ad4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b363a55-0292-4b2e-9d34-2c684b90d510),volume_type_id=8b363a55-0292-4b2e-9d34-2c684b90d510)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:52:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] Creating volume c5dfd826-dbc6-423b-9f8d-f762a29c56ad {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:52:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:52:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:52:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:52:28 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:52:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:28 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad 1073741824 Sep 10 19:52:28 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:28 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58" returned: 0 in 0.493s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:28 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58 Sep 10 19:52:28 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:28 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-74643f1b-7005-4868-925f-72ce9f8eeb58" returned: 0 in 0.336s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:28 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-quobyte-74643f1b-7005-4868-925f-72ce9f8eeb58" released by "delete_volume" :: held 0.952s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:28 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad 1073741824" returned: 0 in 0.667s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:29 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Created reservations ['86412080-bbda-452d-b64e-d6173ce4da7a', '5d4fd2c2-0ea0-40c1-bd1a-8aea4a96fcd8', '542e756e-6089-4520-a664-b6e002625447', '4a4bed5b-1bdb-47df-9454-7bac8154c6a0'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:52:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:29 devstack sudo[99410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad Sep 10 19:52:29 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:29 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:52:29 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:52:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:29 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:52:29 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:29 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad" returned: 0 in 0.383s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:29 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:52:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a08ac92-87b9-4eaf-98eb-a93efd9e3f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3717a5a3-d8a4-4f0c-8250-a4d8f0b62ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:29 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] Volume volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad (c5dfd826-dbc6-423b-9f8d-f762a29c56ad): created successfully Sep 10 19:52:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3717a5a3-d8a4-4f0c-8250-a4d8f0b62ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] Flow 'volume_create_manager' (61e5a43a-80e2-406e-9a3a-1f0b6bdf2174) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:52:29 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:UPDATE=166,cinder:SELECT=136,cinder:INSERT=50,cinder:DELETE=12 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:52:29 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-2f4f6b69-9785-47b3-8ff5-6e639f55f94d tempest-GroupSnapshotsV319Test-620001504 None] Created volume successfully. Sep 10 19:52:29 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.508s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:29 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:52:29 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Deleted volume successfully. Sep 10 19:52:29 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ad3885b0-d2c4-4ffe-8efb-8bdf52535b8c tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-74643f1b-7005-4868-925f-72ce9f8eeb58-delete_volume" released by "delete_volume" :: held 6.198s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:31 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-e24437d4-2539-4cc5-9223-0e13b09811d6 tempest-GroupSnapshotsV319Test-620001504 None] GroupSnapshot 4784c79c-2305-4076-9c1a-ae228d552d6c: creating. Sep 10 19:52:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e24437d4-2539-4cc5-9223-0e13b09811d6 tempest-GroupSnapshotsV319Test-620001504 None] Group snapshot 4784c79c-2305-4076-9c1a-ae228d552d6c: creating. {{(pid=88093) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 10 19:52:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e24437d4-2539-4cc5-9223-0e13b09811d6 tempest-GroupSnapshotsV319Test-620001504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e24437d4-2539-4cc5-9223-0e13b09811d6 tempest-GroupSnapshotsV319Test-620001504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-e24437d4-2539-4cc5-9223-0e13b09811d6 tempest-GroupSnapshotsV319Test-620001504 None] Creating offline snapshot 5bdb9627-0785-4727-a671-ba98a24c1e0b of volume c5dfd826-dbc6-423b-9f8d-f762a29c56ad {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 19:52:31 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96a4e27-62be-4a7d-b20d-d57a4f2c3a71]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e24437d4-2539-4cc5-9223-0e13b09811d6 tempest-GroupSnapshotsV319Test-620001504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:31 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:52:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] Flow 'volume_create_manager' (e8078e56-0bd1-4e90-8c5f-d9bb021c2d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:52:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82793b0b-4302-4589-972b-6015951fdbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82793b0b-4302-4589-972b-6015951fdbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1807119810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08077883-2419-47e6-a3ee-ed9124f4a18e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a7957a30084d0991f06e4b0cbe414f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:52:31Z,use_quota=True,user_id='40c9b424e47a49cc9a1f575843c28bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75a2b3b0-b17b-4310-97cc-5cfa2e4b8126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75a2b3b0-b17b-4310-97cc-5cfa2e4b8126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50af7456-57db-4fd8-94eb-fedcad598593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50af7456-57db-4fd8-94eb-fedcad598593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08077883-2419-47e6-a3ee-ed9124f4a18e', 'volume_name': 'volume-08077883-2419-47e6-a3ee-ed9124f4a18e', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a32218bb-ba35-4d69-a87f-14417f58ca71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a32218bb-ba35-4d69-a87f-14417f58ca71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9468d6da-7b52-4fc0-b7a0-b6669ca6d180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:31 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] Volume 08077883-2419-47e6-a3ee-ed9124f4a18e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08077883-2419-47e6-a3ee-ed9124f4a18e', 'volume_size': 1} Sep 10 19:52:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:31 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad Sep 10 19:52:31 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:31 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e24437d4-2539-4cc5-9223-0e13b09811d6 tempest-GroupSnapshotsV319Test-620001504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad" returned: 0 in 0.419s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e24437d4-2539-4cc5-9223-0e13b09811d6 tempest-GroupSnapshotsV319Test-620001504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad.5bdb9627-0785-4727-a671-ba98a24c1e0b 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:31 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad.5bdb9627-0785-4727-a671-ba98a24c1e0b 1G Sep 10 19:52:31 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:32 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e24437d4-2539-4cc5-9223-0e13b09811d6 tempest-GroupSnapshotsV319Test-620001504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad.5bdb9627-0785-4727-a671-ba98a24c1e0b 1G" returned: 0 in 0.525s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e24437d4-2539-4cc5-9223-0e13b09811d6 tempest-GroupSnapshotsV319Test-620001504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad.5bdb9627-0785-4727-a671-ba98a24c1e0b {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:32 devstack sudo[99464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad.5bdb9627-0785-4727-a671-ba98a24c1e0b Sep 10 19:52:32 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:32 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e24437d4-2539-4cc5-9223-0e13b09811d6 tempest-GroupSnapshotsV319Test-620001504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad.5bdb9627-0785-4727-a671-ba98a24c1e0b" returned: 0 in 0.382s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:32 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-e24437d4-2539-4cc5-9223-0e13b09811d6 tempest-GroupSnapshotsV319Test-620001504 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad.5bdb9627-0785-4727-a671-ba98a24c1e0b is being set with open permissions: ugo+rw: NotImplementedError Sep 10 19:52:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e24437d4-2539-4cc5-9223-0e13b09811d6 tempest-GroupSnapshotsV319Test-620001504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad.5bdb9627-0785-4727-a671-ba98a24c1e0b {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:32 devstack sudo[99470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad.5bdb9627-0785-4727-a671-ba98a24c1e0b Sep 10 19:52:32 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:32 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e24437d4-2539-4cc5-9223-0e13b09811d6 tempest-GroupSnapshotsV319Test-620001504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad.5bdb9627-0785-4727-a671-ba98a24c1e0b" returned: 0 in 0.312s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e24437d4-2539-4cc5-9223-0e13b09811d6 tempest-GroupSnapshotsV319Test-620001504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:32 devstack sudo[99473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad.info Sep 10 19:52:32 devstack sudo[99473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:33 devstack sudo[99473]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e24437d4-2539-4cc5-9223-0e13b09811d6 tempest-GroupSnapshotsV319Test-620001504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad.info" returned: 0 in 0.435s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:33 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-e24437d4-2539-4cc5-9223-0e13b09811d6 tempest-GroupSnapshotsV319Test-620001504 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad.info is being set with open permissions: ugo+rw: NotImplementedError Sep 10 19:52:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e24437d4-2539-4cc5-9223-0e13b09811d6 tempest-GroupSnapshotsV319Test-620001504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:33 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad.info Sep 10 19:52:33 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:33 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e24437d4-2539-4cc5-9223-0e13b09811d6 tempest-GroupSnapshotsV319Test-620001504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad.info" returned: 0 in 0.290s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e24437d4-2539-4cc5-9223-0e13b09811d6 tempest-GroupSnapshotsV319Test-620001504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.503s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.338s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:33 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1807119810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08077883-2419-47e6-a3ee-ed9124f4a18e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a7957a30084d0991f06e4b0cbe414f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:52:31Z,use_quota=True,user_id='40c9b424e47a49cc9a1f575843c28bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:52:33 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] Creating volume 08077883-2419-47e6-a3ee-ed9124f4a18e {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:52:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:33 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:52:33 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:52:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:33 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:52:33 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:52:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:33 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e 1073741824 Sep 10 19:52:33 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:33 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-e24437d4-2539-4cc5-9223-0e13b09811d6 tempest-GroupSnapshotsV319Test-620001504 None] group_snapshot 4784c79c-2305-4076-9c1a-ae228d552d6c: created successfully Sep 10 19:52:33 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:52:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] Flow 'volume_create_manager' (a64a8011-5b47-4724-ba29-dfe9f5ccb197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:52:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbc0d50b-0988-4e19-b64b-889780aaab6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbc0d50b-0988-4e19-b64b-889780aaab6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2107733495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ab1416-17c5-4416-ab44-b28d10b8b9e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba1e6bd0de4545b485299f079094c9d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:52:34Z,use_quota=True,user_id='ee9fea32f7e34508a4fca3bde1a37cf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93bfc825-9619-4370-b266-17790a6f401c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93bfc825-9619-4370-b266-17790a6f401c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b76e805-4895-4ddc-ab7c-7409c476af9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b76e805-4895-4ddc-ab7c-7409c476af9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2ab1416-17c5-4416-ab44-b28d10b8b9e2', 'volume_name': 'volume-e2ab1416-17c5-4416-ab44-b28d10b8b9e2', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e0ab83-21a1-4290-bc29-d735d860a9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e0ab83-21a1-4290-bc29-d735d860a9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa72dcfe-1f69-4eb5-800d-9537afcd6677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:33 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] Volume e2ab1416-17c5-4416-ab44-b28d10b8b9e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2ab1416-17c5-4416-ab44-b28d10b8b9e2', 'volume_size': 1} Sep 10 19:52:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:34 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e 1073741824" returned: 0 in 0.543s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:34 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e Sep 10 19:52:34 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:34 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e" returned: 0 in 0.319s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:34 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:52:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.701s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:34 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2107733495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ab1416-17c5-4416-ab44-b28d10b8b9e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba1e6bd0de4545b485299f079094c9d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:52:34Z,use_quota=True,user_id='ee9fea32f7e34508a4fca3bde1a37cf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:52:34 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] Creating volume e2ab1416-17c5-4416-ab44-b28d10b8b9e2 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:52:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:34 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:52:34 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:52:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:34 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:52:34 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:52:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e2ab1416-17c5-4416-ab44-b28d10b8b9e2 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9468d6da-7b52-4fc0-b7a0-b6669ca6d180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08077883-2419-47e6-a3ee-ed9124f4a18e', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:34 devstack sudo[99488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e2ab1416-17c5-4416-ab44-b28d10b8b9e2 1073741824 Sep 10 19:52:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d407b6b-1851-4e7e-a317-cfbd88b1927a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:34 devstack sudo[99488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:34 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] Volume volume-08077883-2419-47e6-a3ee-ed9124f4a18e (08077883-2419-47e6-a3ee-ed9124f4a18e): created successfully Sep 10 19:52:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d407b6b-1851-4e7e-a317-cfbd88b1927a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] Flow 'volume_create_manager' (e8078e56-0bd1-4e90-8c5f-d9bb021c2d67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:52:34 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-cca2566d-30f7-4a5e-a8e3-6cee0eed325b tempest-VolumesDeleteCascade-2066102729 None] Created volume successfully. Sep 10 19:52:34 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-15fb71eb-dbc2-4b81-9c97-a5cc8269f4e5 tempest-GroupSnapshotsV319Test-620001504 None] group_snapshot 4784c79c-2305-4076-9c1a-ae228d552d6c: deleting Sep 10 19:52:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-15fb71eb-dbc2-4b81-9c97-a5cc8269f4e5 tempest-GroupSnapshotsV319Test-620001504 None] group_snapshot 4784c79c-2305-4076-9c1a-ae228d552d6c: deleting {{(pid=88093) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 10 19:52:35 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-15fb71eb-dbc2-4b81-9c97-a5cc8269f4e5 tempest-GroupSnapshotsV319Test-620001504 None] Acquiring lock "cinder-quobyte-c5dfd826-dbc6-423b-9f8d-f762a29c56ad" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:35 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-15fb71eb-dbc2-4b81-9c97-a5cc8269f4e5 tempest-GroupSnapshotsV319Test-620001504 None] Lock "cinder-quobyte-c5dfd826-dbc6-423b-9f8d-f762a29c56ad" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:35 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-15fb71eb-dbc2-4b81-9c97-a5cc8269f4e5 tempest-GroupSnapshotsV319Test-620001504 None] Acquiring lock "cinder-quobyte-5bdb9627-0785-4727-a671-ba98a24c1e0b" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:35 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-15fb71eb-dbc2-4b81-9c97-a5cc8269f4e5 tempest-GroupSnapshotsV319Test-620001504 None] Lock "cinder-quobyte-5bdb9627-0785-4727-a671-ba98a24c1e0b" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:35 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-15fb71eb-dbc2-4b81-9c97-a5cc8269f4e5 tempest-GroupSnapshotsV319Test-620001504 None] Deleting offline snapshot 5bdb9627-0785-4727-a671-ba98a24c1e0b of volume c5dfd826-dbc6-423b-9f8d-f762a29c56ad {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 19:52:35 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-15fb71eb-dbc2-4b81-9c97-a5cc8269f4e5 tempest-GroupSnapshotsV319Test-620001504 None] snapshot_file for this snap is: volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad.5bdb9627-0785-4727-a671-ba98a24c1e0b {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 19:52:35 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c3b2ed-d279-4507-b9a0-439909519e53]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-15fb71eb-dbc2-4b81-9c97-a5cc8269f4e5 tempest-GroupSnapshotsV319Test-620001504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad.5bdb9627-0785-4727-a671-ba98a24c1e0b {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:35 devstack sudo[99488]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e2ab1416-17c5-4416-ab44-b28d10b8b9e2 1073741824" returned: 0 in 0.666s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:35 devstack sudo[99493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad.5bdb9627-0785-4727-a671-ba98a24c1e0b Sep 10 19:52:35 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e2ab1416-17c5-4416-ab44-b28d10b8b9e2 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:35 devstack sudo[99496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e2ab1416-17c5-4416-ab44-b28d10b8b9e2 Sep 10 19:52:35 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:35 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-15fb71eb-dbc2-4b81-9c97-a5cc8269f4e5 tempest-GroupSnapshotsV319Test-620001504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad.5bdb9627-0785-4727-a671-ba98a24c1e0b" returned: 0 in 0.452s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:35 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-15fb71eb-dbc2-4b81-9c97-a5cc8269f4e5 tempest-GroupSnapshotsV319Test-620001504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:52:35 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[832f2fbc-6357-417e-b146-00daed5afb09]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-15fb71eb-dbc2-4b81-9c97-a5cc8269f4e5 tempest-GroupSnapshotsV319Test-620001504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:35 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e2ab1416-17c5-4416-ab44-b28d10b8b9e2" returned: 0 in 0.368s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:35 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:52:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa72dcfe-1f69-4eb5-800d-9537afcd6677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2ab1416-17c5-4416-ab44-b28d10b8b9e2', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7868c574-fd4f-4957-85cd-e078c2e0ea91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1eef32ad-73f7-4a1b-ba28-1f20ce05ec5b tempest-VolumesDeleteCascade-2066102729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1eef32ad-73f7-4a1b-ba28-1f20ce05ec5b tempest-VolumesDeleteCascade-2066102729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:35 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] Volume volume-e2ab1416-17c5-4416-ab44-b28d10b8b9e2 (e2ab1416-17c5-4416-ab44-b28d10b8b9e2): created successfully Sep 10 19:52:35 devstack sudo[99502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad Sep 10 19:52:35 devstack sudo[99502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7868c574-fd4f-4957-85cd-e078c2e0ea91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] Flow 'volume_create_manager' (a64a8011-5b47-4724-ba29-dfe9f5ccb197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:52:35 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-1eef32ad-73f7-4a1b-ba28-1f20ce05ec5b tempest-VolumesDeleteCascade-2066102729 None] Creating offline snapshot 2c145628-3db0-44fb-a96b-49d90a5a5d45 of volume 08077883-2419-47e6-a3ee-ed9124f4a18e {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 19:52:35 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-ecd77678-c1bd-42a1-9456-b1677db46bf0 tempest-VolumesTransfersV357Test-154891775 None] Created volume successfully. Sep 10 19:52:35 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c4fd33-312a-4888-a591-9c37dfebb0f0]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1eef32ad-73f7-4a1b-ba28-1f20ce05ec5b tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:36 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e Sep 10 19:52:36 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:36 devstack sudo[99502]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-15fb71eb-dbc2-4b81-9c97-a5cc8269f4e5 tempest-GroupSnapshotsV319Test-620001504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad" returned: 0 in 0.590s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-15fb71eb-dbc2-4b81-9c97-a5cc8269f4e5 tempest-GroupSnapshotsV319Test-620001504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad.5bdb9627-0785-4727-a671-ba98a24c1e0b {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:36 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad.5bdb9627-0785-4727-a671-ba98a24c1e0b Sep 10 19:52:36 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:36 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1eef32ad-73f7-4a1b-ba28-1f20ce05ec5b tempest-VolumesDeleteCascade-2066102729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e" returned: 0 in 0.534s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1eef32ad-73f7-4a1b-ba28-1f20ce05ec5b tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e.2c145628-3db0-44fb-a96b-49d90a5a5d45 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:36 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e.2c145628-3db0-44fb-a96b-49d90a5a5d45 1G Sep 10 19:52:36 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:36 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-15fb71eb-dbc2-4b81-9c97-a5cc8269f4e5 tempest-GroupSnapshotsV319Test-620001504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad.5bdb9627-0785-4727-a671-ba98a24c1e0b" returned: 0 in 0.455s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-15fb71eb-dbc2-4b81-9c97-a5cc8269f4e5 tempest-GroupSnapshotsV319Test-620001504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad.5bdb9627-0785-4727-a671-ba98a24c1e0b {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:36 devstack sudo[99523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad.5bdb9627-0785-4727-a671-ba98a24c1e0b Sep 10 19:52:36 devstack sudo[99523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:36 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1eef32ad-73f7-4a1b-ba28-1f20ce05ec5b tempest-VolumesDeleteCascade-2066102729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e.2c145628-3db0-44fb-a96b-49d90a5a5d45 1G" returned: 0 in 0.574s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1eef32ad-73f7-4a1b-ba28-1f20ce05ec5b tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08077883-2419-47e6-a3ee-ed9124f4a18e -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e.2c145628-3db0-44fb-a96b-49d90a5a5d45 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:37 devstack sudo[99527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08077883-2419-47e6-a3ee-ed9124f4a18e -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e.2c145628-3db0-44fb-a96b-49d90a5a5d45 Sep 10 19:52:37 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:37 devstack sudo[99523]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:37 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-b3f2752d-1ba2-4776-b69e-58d66bdcdeba tempest-VolumesTransfersV357Test-1681829273 None] Transfer volume completed successfully. Sep 10 19:52:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-15fb71eb-dbc2-4b81-9c97-a5cc8269f4e5 tempest-GroupSnapshotsV319Test-620001504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad.5bdb9627-0785-4727-a671-ba98a24c1e0b" returned: 0 in 0.395s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-15fb71eb-dbc2-4b81-9c97-a5cc8269f4e5 tempest-GroupSnapshotsV319Test-620001504 None] Lock "cinder-quobyte-5bdb9627-0785-4727-a671-ba98a24c1e0b" released by "_delete_snapshot" :: held 2.037s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-15fb71eb-dbc2-4b81-9c97-a5cc8269f4e5 tempest-GroupSnapshotsV319Test-620001504 None] Lock "cinder-quobyte-c5dfd826-dbc6-423b-9f8d-f762a29c56ad" released by "delete_snapshot" :: held 2.074s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:37 devstack cinder-volume[88093]: WARNING cinder.quota [None req-15fb71eb-dbc2-4b81-9c97-a5cc8269f4e5 tempest-GroupSnapshotsV319Test-620001504 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1477015786 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1477015786, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:52:37 devstack cinder-volume[88093]: WARNING cinder.quota [None req-15fb71eb-dbc2-4b81-9c97-a5cc8269f4e5 tempest-GroupSnapshotsV319Test-620001504 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1477015786 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1477015786, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:52:37 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-15fb71eb-dbc2-4b81-9c97-a5cc8269f4e5 tempest-GroupSnapshotsV319Test-620001504 None] Created reservations ['c0b1ac2a-a357-4f34-8380-d40bc44d57e6', 'eadcf995-07a1-458c-a0d1-c01a6906d164', '58aadf92-9769-43ee-b87d-cf4ff834000c', '45e71b1a-70b0-419b-a763-3cb17fc4fe00'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:52:37 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-15fb71eb-dbc2-4b81-9c97-a5cc8269f4e5 tempest-GroupSnapshotsV319Test-620001504 None] group_snapshot 4784c79c-2305-4076-9c1a-ae228d552d6c: deleted successfully Sep 10 19:52:37 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1eef32ad-73f7-4a1b-ba28-1f20ce05ec5b tempest-VolumesDeleteCascade-2066102729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08077883-2419-47e6-a3ee-ed9124f4a18e -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e.2c145628-3db0-44fb-a96b-49d90a5a5d45" returned: 0 in 0.395s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:37 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-1eef32ad-73f7-4a1b-ba28-1f20ce05ec5b tempest-VolumesDeleteCascade-2066102729 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e.2c145628-3db0-44fb-a96b-49d90a5a5d45 is being set with open permissions: ugo+rw Sep 10 19:52:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1eef32ad-73f7-4a1b-ba28-1f20ce05ec5b tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e.2c145628-3db0-44fb-a96b-49d90a5a5d45 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:37 devstack sudo[99534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e.2c145628-3db0-44fb-a96b-49d90a5a5d45 Sep 10 19:52:37 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:37 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1eef32ad-73f7-4a1b-ba28-1f20ce05ec5b tempest-VolumesDeleteCascade-2066102729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e.2c145628-3db0-44fb-a96b-49d90a5a5d45" returned: 0 in 0.352s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5fda1c9d-3053-4f94-9093-ad93d262ce56 tempest-GroupSnapshotsV319Test-620001504 None] Acquiring lock "cinder-quobyte-c5dfd826-dbc6-423b-9f8d-f762a29c56ad" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5fda1c9d-3053-4f94-9093-ad93d262ce56 tempest-GroupSnapshotsV319Test-620001504 None] Lock "cinder-quobyte-c5dfd826-dbc6-423b-9f8d-f762a29c56ad" acquired by "delete_volume" :: waited 0.032s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-43a99334-a2a6-4016-bdb1-34fed22eb6c5 tempest-VolumesTransfersV357Test-1058624454 None] Acquiring lock "cinder-e2ab1416-17c5-4416-ab44-b28d10b8b9e2-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1eef32ad-73f7-4a1b-ba28-1f20ce05ec5b tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:37 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f0796b-0e2d-470d-b7f1-0129f58c66f8]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5fda1c9d-3053-4f94-9093-ad93d262ce56 tempest-GroupSnapshotsV319Test-620001504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:37 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e.info Sep 10 19:52:37 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-43a99334-a2a6-4016-bdb1-34fed22eb6c5 tempest-VolumesTransfersV357Test-1058624454 None] Lock "cinder-e2ab1416-17c5-4416-ab44-b28d10b8b9e2-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-43a99334-a2a6-4016-bdb1-34fed22eb6c5 tempest-VolumesTransfersV357Test-1058624454 None] Acquiring lock "cinder-quobyte-e2ab1416-17c5-4416-ab44-b28d10b8b9e2" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-43a99334-a2a6-4016-bdb1-34fed22eb6c5 tempest-VolumesTransfersV357Test-1058624454 None] Lock "cinder-quobyte-e2ab1416-17c5-4416-ab44-b28d10b8b9e2" acquired by "delete_volume" :: waited 0.026s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:38 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f80e984-d748-4fc2-8e51-19895c7c7ec6]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-43a99334-a2a6-4016-bdb1-34fed22eb6c5 tempest-VolumesTransfersV357Test-1058624454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e2ab1416-17c5-4416-ab44-b28d10b8b9e2 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:38 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad Sep 10 19:52:38 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:38 devstack sudo[99540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e2ab1416-17c5-4416-ab44-b28d10b8b9e2 Sep 10 19:52:38 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:38 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1eef32ad-73f7-4a1b-ba28-1f20ce05ec5b tempest-VolumesDeleteCascade-2066102729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e.info" returned: 0 in 0.457s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:38 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-1eef32ad-73f7-4a1b-ba28-1f20ce05ec5b tempest-VolumesDeleteCascade-2066102729 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e.info is being set with open permissions: ugo+rw Sep 10 19:52:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1eef32ad-73f7-4a1b-ba28-1f20ce05ec5b tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:38 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e.info Sep 10 19:52:38 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:38 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5fda1c9d-3053-4f94-9093-ad93d262ce56 tempest-GroupSnapshotsV319Test-620001504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad" returned: 0 in 0.570s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5fda1c9d-3053-4f94-9093-ad93d262ce56 tempest-GroupSnapshotsV319Test-620001504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:38 devstack sudo[99549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad Sep 10 19:52:38 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:38 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1eef32ad-73f7-4a1b-ba28-1f20ce05ec5b tempest-VolumesDeleteCascade-2066102729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e.info" returned: 0 in 0.298s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:38 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1eef32ad-73f7-4a1b-ba28-1f20ce05ec5b tempest-VolumesDeleteCascade-2066102729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.838s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-43a99334-a2a6-4016-bdb1-34fed22eb6c5 tempest-VolumesTransfersV357Test-1058624454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e2ab1416-17c5-4416-ab44-b28d10b8b9e2" returned: 0 in 0.524s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-43a99334-a2a6-4016-bdb1-34fed22eb6c5 tempest-VolumesTransfersV357Test-1058624454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e2ab1416-17c5-4416-ab44-b28d10b8b9e2 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:38 devstack sudo[99556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e2ab1416-17c5-4416-ab44-b28d10b8b9e2 Sep 10 19:52:38 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:38 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-1eef32ad-73f7-4a1b-ba28-1f20ce05ec5b tempest-VolumesDeleteCascade-2066102729 None] Create snapshot completed successfully Sep 10 19:52:38 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5fda1c9d-3053-4f94-9093-ad93d262ce56 tempest-GroupSnapshotsV319Test-620001504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c5dfd826-dbc6-423b-9f8d-f762a29c56ad" returned: 0 in 0.291s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5fda1c9d-3053-4f94-9093-ad93d262ce56 tempest-GroupSnapshotsV319Test-620001504 None] Lock "cinder-quobyte-c5dfd826-dbc6-423b-9f8d-f762a29c56ad" released by "delete_volume" :: held 0.992s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:38 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-5fda1c9d-3053-4f94-9093-ad93d262ce56 tempest-GroupSnapshotsV319Test-620001504 None] Created reservations ['292eafc7-9ae7-48ce-8d8a-bcdb08310f4e'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:52:38 devstack cinder-volume[88093]: WARNING cinder.quota [None req-5fda1c9d-3053-4f94-9093-ad93d262ce56 tempest-GroupSnapshotsV319Test-620001504 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1477015786 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1477015786, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:52:38 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-5fda1c9d-3053-4f94-9093-ad93d262ce56 tempest-GroupSnapshotsV319Test-620001504 None] Created reservations ['11e0b0a1-e0e0-400a-b630-f1e82b0dde8f', '635c0d55-d71d-49e3-ae41-8b02deec58df', '1519927f-08fd-4ca9-b9ac-c0d1c99624bc', '40f5c9d3-e459-43a4-95bd-d99132391f52'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:52:38 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-43a99334-a2a6-4016-bdb1-34fed22eb6c5 tempest-VolumesTransfersV357Test-1058624454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e2ab1416-17c5-4416-ab44-b28d10b8b9e2" returned: 0 in 0.360s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:39 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-43a99334-a2a6-4016-bdb1-34fed22eb6c5 tempest-VolumesTransfersV357Test-1058624454 None] Lock "cinder-quobyte-e2ab1416-17c5-4416-ab44-b28d10b8b9e2" released by "delete_volume" :: held 0.983s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:39 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-43a99334-a2a6-4016-bdb1-34fed22eb6c5 tempest-VolumesTransfersV357Test-1058624454 None] Created reservations ['9dbf1e67-4152-40c4-9c60-e58464275235', 'ece90b52-d67a-4361-b351-45824f19f6f0', '4974fdf0-b38d-4eec-a275-ef52db5f7ebd', '4fefac8b-dc6d-45c2-8d50-470047f03165'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:52:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5fda1c9d-3053-4f94-9093-ad93d262ce56 tempest-GroupSnapshotsV319Test-620001504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5fda1c9d-3053-4f94-9093-ad93d262ce56 tempest-GroupSnapshotsV319Test-620001504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:39 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5fda1c9d-3053-4f94-9093-ad93d262ce56 tempest-GroupSnapshotsV319Test-620001504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:52:39 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5fda1c9d-3053-4f94-9093-ad93d262ce56 tempest-GroupSnapshotsV319Test-620001504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:52:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5fda1c9d-3053-4f94-9093-ad93d262ce56 tempest-GroupSnapshotsV319Test-620001504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5fda1c9d-3053-4f94-9093-ad93d262ce56 tempest-GroupSnapshotsV319Test-620001504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:39 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:52:39 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-43a99334-a2a6-4016-bdb1-34fed22eb6c5 tempest-VolumesTransfersV357Test-1058624454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-43a99334-a2a6-4016-bdb1-34fed22eb6c5 tempest-VolumesTransfersV357Test-1058624454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:39 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-43a99334-a2a6-4016-bdb1-34fed22eb6c5 tempest-VolumesTransfersV357Test-1058624454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:52:39 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-43a99334-a2a6-4016-bdb1-34fed22eb6c5 tempest-VolumesTransfersV357Test-1058624454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:52:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-43a99334-a2a6-4016-bdb1-34fed22eb6c5 tempest-VolumesTransfersV357Test-1058624454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-43a99334-a2a6-4016-bdb1-34fed22eb6c5 tempest-VolumesTransfersV357Test-1058624454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:39 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:52:39 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:39 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5fda1c9d-3053-4f94-9093-ad93d262ce56 tempest-GroupSnapshotsV319Test-620001504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.416s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:39 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-5fda1c9d-3053-4f94-9093-ad93d262ce56 tempest-GroupSnapshotsV319Test-620001504 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:52:39 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-5fda1c9d-3053-4f94-9093-ad93d262ce56 tempest-GroupSnapshotsV319Test-620001504 None] Delete group completed successfully. Sep 10 19:52:39 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-43a99334-a2a6-4016-bdb1-34fed22eb6c5 tempest-VolumesTransfersV357Test-1058624454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.416s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:39 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-43a99334-a2a6-4016-bdb1-34fed22eb6c5 tempest-VolumesTransfersV357Test-1058624454 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:52:39 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-43a99334-a2a6-4016-bdb1-34fed22eb6c5 tempest-VolumesTransfersV357Test-1058624454 None] Deleted volume successfully. Sep 10 19:52:39 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-43a99334-a2a6-4016-bdb1-34fed22eb6c5 tempest-VolumesTransfersV357Test-1058624454 None] Lock "cinder-e2ab1416-17c5-4416-ab44-b28d10b8b9e2-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Flow 'volume_create_manager' (2498e7d6-23d8-4e91-9a5e-1465cbefde21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a72492-8b1d-413d-994d-edaea5dc5deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a72492-8b1d-413d-994d-edaea5dc5deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-873696395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a4babb-72b7-41ba-a81f-7abb1b9a5246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a7957a30084d0991f06e4b0cbe414f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2c145628-3db0-44fb-a96b-49d90a5a5d45,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:52:40Z,use_quota=True,user_id='40c9b424e47a49cc9a1f575843c28bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04036001-ca75-4cc6-b943-50aec8be13e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04036001-ca75-4cc6-b943-50aec8be13e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e5d8f9f-376c-464e-aeae-072d403dea92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e5d8f9f-376c-464e-aeae-072d403dea92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '52a4babb-72b7-41ba-a81f-7abb1b9a5246', 'volume_name': 'volume-52a4babb-72b7-41ba-a81f-7abb1b9a5246', 'volume_size': 1, 'snapshot_id': '2c145628-3db0-44fb-a96b-49d90a5a5d45'}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f409a63-3181-4427-bd34-d3d7fe8cc0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f409a63-3181-4427-bd34-d3d7fe8cc0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37f02dc-65f0-485f-9c64-732c6a6edb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:40 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Volume 52a4babb-72b7-41ba-a81f-7abb1b9a5246: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-52a4babb-72b7-41ba-a81f-7abb1b9a5246', 'volume_size': 1, 'snapshot_id': '2c145628-3db0-44fb-a96b-49d90a5a5d45'} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Acquiring lock "cinder-quobyte-2c145628-3db0-44fb-a96b-49d90a5a5d45-52a4babb-72b7-41ba-a81f-7abb1b9a5246" by "_create_volume_from_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-quobyte-2c145628-3db0-44fb-a96b-49d90a5a5d45-52a4babb-72b7-41ba-a81f-7abb1b9a5246" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Creating volume 52a4babb-72b7-41ba-a81f-7abb1b9a5246 from snapshot 2c145628-3db0-44fb-a96b-49d90a5a5d45 {{(pid=88093) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Acquiring lock "cinder-quobyte-52a4babb-72b7-41ba-a81f-7abb1b9a5246" by "_copy_volume_from_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-quobyte-52a4babb-72b7-41ba-a81f-7abb1b9a5246" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] snapshot: 2c145628-3db0-44fb-a96b-49d90a5a5d45, volume: 52a4babb-72b7-41ba-a81f-7abb1b9a5246, {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] Flow 'volume_create_manager' (63a2bec6-d51d-4ac1-8c7c-d3012c157c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4bdb2f7-684c-448e-bb08-18e51a5fbd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[54767a83-6d22-4fbc-97a7-98a99edc8609]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e.2c145628-3db0-44fb-a96b-49d90a5a5d45 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4bdb2f7-684c-448e-bb08-18e51a5fbd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2130805050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28be37a7-92f3-4990-bcfa-07fc1fece06d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba1e6bd0de4545b485299f079094c9d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:52:40Z,use_quota=True,user_id='ee9fea32f7e34508a4fca3bde1a37cf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfe17261-65de-46f8-ac0f-953b82c0ed53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfe17261-65de-46f8-ac0f-953b82c0ed53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74061369-4302-4d95-bfe2-ec4d845dd728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74061369-4302-4d95-bfe2-ec4d845dd728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28be37a7-92f3-4990-bcfa-07fc1fece06d', 'volume_name': 'volume-28be37a7-92f3-4990-bcfa-07fc1fece06d', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76980697-6c50-495b-92ed-bf92dcdfd45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76980697-6c50-495b-92ed-bf92dcdfd45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (791ec56e-7bc0-42cd-960c-e1a330a12aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:40 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] Volume 28be37a7-92f3-4990-bcfa-07fc1fece06d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28be37a7-92f3-4990-bcfa-07fc1fece06d', 'volume_size': 1} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:40 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e.2c145628-3db0-44fb-a96b-49d90a5a5d45 Sep 10 19:52:40 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:40 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e.2c145628-3db0-44fb-a96b-49d90a5a5d45" returned: 0 in 0.465s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08077883-2419-47e6-a3ee-ed9124f4a18e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe4cfe1-303f-4e96-bce1-ca33a4bcc526]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:41 devstack sudo[99573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e Sep 10 19:52:41 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:41 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e" returned: 0 in 0.437s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 19:52:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Creating direct copy from snapshot {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 19:52:41 devstack cinder-volume[88093]: DEBUG cinder.utils [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Path /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-52a4babb-72b7-41ba-a81f-7abb1b9a5246 not found in is_blk_device check {{(pid=88093) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 19:52:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-52a4babb-72b7-41ba-a81f-7abb1b9a5246 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:41 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-52a4babb-72b7-41ba-a81f-7abb1b9a5246 Sep 10 19:52:41 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:47 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-52a4babb-72b7-41ba-a81f-7abb1b9a5246" returned: 0 in 5.952s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:47 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Image conversion details: src /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e, size 1024.00 MB, duration 5.95 sec, destination /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-52a4babb-72b7-41ba-a81f-7abb1b9a5246 {{(pid=88093) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 19:52:47 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Converted 1024.00 MB image at 172.00 MB/s Sep 10 19:52:47 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-52a4babb-72b7-41ba-a81f-7abb1b9a5246 is being set with open permissions: ugo+rw Sep 10 19:52:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-52a4babb-72b7-41ba-a81f-7abb1b9a5246 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:47 devstack sudo[99599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-52a4babb-72b7-41ba-a81f-7abb1b9a5246 Sep 10 19:52:47 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:47 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-52a4babb-72b7-41ba-a81f-7abb1b9a5246" returned: 0 in 0.316s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:47 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-quobyte-52a4babb-72b7-41ba-a81f-7abb1b9a5246" released by "_copy_volume_from_snapshot" :: held 7.364s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:47 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-quobyte-2c145628-3db0-44fb-a96b-49d90a5a5d45-52a4babb-72b7-41ba-a81f-7abb1b9a5246" released by "_create_volume_from_snapshot" :: held 7.463s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.481s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.175s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:47 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2130805050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28be37a7-92f3-4990-bcfa-07fc1fece06d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba1e6bd0de4545b485299f079094c9d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:52:40Z,use_quota=True,user_id='ee9fea32f7e34508a4fca3bde1a37cf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:52:47 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] Creating volume 28be37a7-92f3-4990-bcfa-07fc1fece06d {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:52:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:47 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:52:47 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:52:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:47 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:52:47 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:52:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-28be37a7-92f3-4990-bcfa-07fc1fece06d 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:47 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-28be37a7-92f3-4990-bcfa-07fc1fece06d 1073741824 Sep 10 19:52:47 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37f02dc-65f0-485f-9c64-732c6a6edb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52a4babb-72b7-41ba-a81f-7abb1b9a5246', 'volume_size': 1, 'snapshot_id': '2c145628-3db0-44fb-a96b-49d90a5a5d45'}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f09c4d-0f4c-4d5f-a28f-d02753471053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:47 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Volume volume-52a4babb-72b7-41ba-a81f-7abb1b9a5246 (52a4babb-72b7-41ba-a81f-7abb1b9a5246): created successfully Sep 10 19:52:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f09c4d-0f4c-4d5f-a28f-d02753471053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Flow 'volume_create_manager' (2498e7d6-23d8-4e91-9a5e-1465cbefde21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:52:47 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-a20935c1-bd4e-4a8c-a337-48e694e4d205 tempest-VolumesDeleteCascade-2066102729 None] Created volume successfully. Sep 10 19:52:48 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-28be37a7-92f3-4990-bcfa-07fc1fece06d 1073741824" returned: 0 in 0.563s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-28be37a7-92f3-4990-bcfa-07fc1fece06d {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:48 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-28be37a7-92f3-4990-bcfa-07fc1fece06d Sep 10 19:52:48 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:48 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-28be37a7-92f3-4990-bcfa-07fc1fece06d" returned: 0 in 0.332s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:48 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:52:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (791ec56e-7bc0-42cd-960c-e1a330a12aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28be37a7-92f3-4990-bcfa-07fc1fece06d', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (634a3bc7-4f6b-4a42-9175-bac02ee844d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:52:48 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] Volume volume-28be37a7-92f3-4990-bcfa-07fc1fece06d (28be37a7-92f3-4990-bcfa-07fc1fece06d): created successfully Sep 10 19:52:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (634a3bc7-4f6b-4a42-9175-bac02ee844d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:52:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] Flow 'volume_create_manager' (63a2bec6-d51d-4ac1-8c7c-d3012c157c65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:52:48 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-34b49008-918b-42a9-8c0f-8d31d45ff44d tempest-VolumesTransfersV357Test-154891775 None] Created volume successfully. Sep 10 19:52:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Acquiring lock "cinder-08077883-2419-47e6-a3ee-ed9124f4a18e-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-08077883-2419-47e6-a3ee-ed9124f4a18e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Performing cascade delete. {{(pid=88093) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 10 19:52:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Acquiring lock "cinder-2c145628-3db0-44fb-a96b-49d90a5a5d45-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-2c145628-3db0-44fb-a96b-49d90a5a5d45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Acquiring lock "cinder-quobyte-08077883-2419-47e6-a3ee-ed9124f4a18e" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-quobyte-08077883-2419-47e6-a3ee-ed9124f4a18e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Acquiring lock "cinder-quobyte-2c145628-3db0-44fb-a96b-49d90a5a5d45" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-quobyte-2c145628-3db0-44fb-a96b-49d90a5a5d45" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Deleting offline snapshot 2c145628-3db0-44fb-a96b-49d90a5a5d45 of volume 08077883-2419-47e6-a3ee-ed9124f4a18e {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 19:52:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] snapshot_file for this snap is: volume-08077883-2419-47e6-a3ee-ed9124f4a18e.2c145628-3db0-44fb-a96b-49d90a5a5d45 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 19:52:49 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[70301518-b941-4d18-85c1-cfbffb8b480c]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e.2c145628-3db0-44fb-a96b-49d90a5a5d45 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:49 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e.2c145628-3db0-44fb-a96b-49d90a5a5d45 Sep 10 19:52:49 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-13c9da17-20de-4cfd-b894-13ee05c9e208 tempest-VolumesTransfersV357Test-1058624454 None] Acquiring lock "cinder-28be37a7-92f3-4990-bcfa-07fc1fece06d-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-13c9da17-20de-4cfd-b894-13ee05c9e208 tempest-VolumesTransfersV357Test-1058624454 None] Lock "cinder-28be37a7-92f3-4990-bcfa-07fc1fece06d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-13c9da17-20de-4cfd-b894-13ee05c9e208 tempest-VolumesTransfersV357Test-1058624454 None] Acquiring lock "cinder-quobyte-28be37a7-92f3-4990-bcfa-07fc1fece06d" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-13c9da17-20de-4cfd-b894-13ee05c9e208 tempest-VolumesTransfersV357Test-1058624454 None] Lock "cinder-quobyte-28be37a7-92f3-4990-bcfa-07fc1fece06d" acquired by "delete_volume" :: waited 0.017s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:49 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[2580e46f-f867-49f6-96ac-428ec25a1163]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-13c9da17-20de-4cfd-b894-13ee05c9e208 tempest-VolumesTransfersV357Test-1058624454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-28be37a7-92f3-4990-bcfa-07fc1fece06d {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:49 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-28be37a7-92f3-4990-bcfa-07fc1fece06d Sep 10 19:52:49 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:50 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e.2c145628-3db0-44fb-a96b-49d90a5a5d45" returned: 0 in 0.609s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:50 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08077883-2419-47e6-a3ee-ed9124f4a18e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:52:50 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3650ab5-2534-4950-b640-d1161b432f05]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:50 devstack sudo[99618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e Sep 10 19:52:50 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:50 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-13c9da17-20de-4cfd-b894-13ee05c9e208 tempest-VolumesTransfersV357Test-1058624454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-28be37a7-92f3-4990-bcfa-07fc1fece06d" returned: 0 in 0.612s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-13c9da17-20de-4cfd-b894-13ee05c9e208 tempest-VolumesTransfersV357Test-1058624454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-28be37a7-92f3-4990-bcfa-07fc1fece06d {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:50 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-28be37a7-92f3-4990-bcfa-07fc1fece06d Sep 10 19:52:50 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:50 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-13c9da17-20de-4cfd-b894-13ee05c9e208 tempest-VolumesTransfersV357Test-1058624454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-28be37a7-92f3-4990-bcfa-07fc1fece06d" returned: 0 in 0.371s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:50 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-13c9da17-20de-4cfd-b894-13ee05c9e208 tempest-VolumesTransfersV357Test-1058624454 None] Lock "cinder-quobyte-28be37a7-92f3-4990-bcfa-07fc1fece06d" released by "delete_volume" :: held 1.037s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:50 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e" returned: 0 in 0.778s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e.2c145628-3db0-44fb-a96b-49d90a5a5d45 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:50 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-13c9da17-20de-4cfd-b894-13ee05c9e208 tempest-VolumesTransfersV357Test-1058624454 None] Created reservations ['323090f1-e57f-4cf5-8a90-0e393605d0fa', 'e6845aa0-8b85-4b53-a477-3d962940bca2', 'f9bdc490-51fc-4e5a-b431-6943197b8209', 'ff23e1f2-8421-4558-8a54-6830b452a6ef'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:52:50 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e.2c145628-3db0-44fb-a96b-49d90a5a5d45 Sep 10 19:52:50 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-13c9da17-20de-4cfd-b894-13ee05c9e208 tempest-VolumesTransfersV357Test-1058624454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-13c9da17-20de-4cfd-b894-13ee05c9e208 tempest-VolumesTransfersV357Test-1058624454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-13c9da17-20de-4cfd-b894-13ee05c9e208 tempest-VolumesTransfersV357Test-1058624454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:52:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-13c9da17-20de-4cfd-b894-13ee05c9e208 tempest-VolumesTransfersV357Test-1058624454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:52:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-13c9da17-20de-4cfd-b894-13ee05c9e208 tempest-VolumesTransfersV357Test-1058624454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-13c9da17-20de-4cfd-b894-13ee05c9e208 tempest-VolumesTransfersV357Test-1058624454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:51 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:52:51 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:51 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e.2c145628-3db0-44fb-a96b-49d90a5a5d45" returned: 0 in 0.503s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e.2c145628-3db0-44fb-a96b-49d90a5a5d45 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:51 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-13c9da17-20de-4cfd-b894-13ee05c9e208 tempest-VolumesTransfersV357Test-1058624454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.346s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:51 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-13c9da17-20de-4cfd-b894-13ee05c9e208 tempest-VolumesTransfersV357Test-1058624454 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:52:51 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-13c9da17-20de-4cfd-b894-13ee05c9e208 tempest-VolumesTransfersV357Test-1058624454 None] Deleted volume successfully. Sep 10 19:52:51 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e.2c145628-3db0-44fb-a96b-49d90a5a5d45 Sep 10 19:52:51 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-13c9da17-20de-4cfd-b894-13ee05c9e208 tempest-VolumesTransfersV357Test-1058624454 None] Lock "cinder-28be37a7-92f3-4990-bcfa-07fc1fece06d-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:51 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e.2c145628-3db0-44fb-a96b-49d90a5a5d45" returned: 0 in 0.311s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-quobyte-2c145628-3db0-44fb-a96b-49d90a5a5d45" released by "_delete_snapshot" :: held 2.336s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-quobyte-08077883-2419-47e6-a3ee-ed9124f4a18e" released by "delete_snapshot" :: held 2.375s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:51 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Created reservations ['b5923e7b-e2cd-402e-a530-3bc6cddebb10', '357281b5-2d6f-479a-8a4e-497da36e7a29', 'f12f1561-c002-4347-b3fc-676538cb7294', '4423e05e-a81a-4191-98da-ccb03a739686'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:52:51 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Delete snapshot completed successfully. Sep 10 19:52:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-2c145628-3db0-44fb-a96b-49d90a5a5d45-delete_snapshot" released by "delete_snapshot" :: held 2.603s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Snapshots deleted, issuing volume delete {{(pid=88093) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 10 19:52:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Acquiring lock "cinder-quobyte-08077883-2419-47e6-a3ee-ed9124f4a18e" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-quobyte-08077883-2419-47e6-a3ee-ed9124f4a18e" acquired by "delete_volume" :: waited 0.032s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:52 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ade55c-42e9-4242-b84a-2e6bb185c979]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:52 devstack sudo[99641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e Sep 10 19:52:52 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:52 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e" returned: 0 in 0.469s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:52 devstack sudo[99646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e Sep 10 19:52:52 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:52 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-08077883-2419-47e6-a3ee-ed9124f4a18e" returned: 0 in 0.357s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-quobyte-08077883-2419-47e6-a3ee-ed9124f4a18e" released by "delete_volume" :: held 0.946s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:53 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Created reservations ['205b06ec-151a-498a-982f-2af12bb35175', '814a0691-e39c-48af-ae4f-f1bad9a40776', 'c16e9a4e-ab03-4376-aeae-433bbf6d9558', '4151a14c-2a57-4e7b-813c-f00cb8d5dc14'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:52:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:53 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:52:53 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:52:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:53 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:52:53 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:53 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.375s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:53 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:52:53 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Deleted volume successfully. Sep 10 19:52:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c5373058-ecd3-4d08-92de-69609dac63c3 tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-08077883-2419-47e6-a3ee-ed9124f4a18e-delete_volume" released by "delete_volume" :: held 4.419s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0926facc-7453-4c43-a993-165077c4e85e tempest-VolumesDeleteCascade-2066102729 None] Acquiring lock "cinder-52a4babb-72b7-41ba-a81f-7abb1b9a5246-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:54 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0926facc-7453-4c43-a993-165077c4e85e tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-52a4babb-72b7-41ba-a81f-7abb1b9a5246-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:54 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0926facc-7453-4c43-a993-165077c4e85e tempest-VolumesDeleteCascade-2066102729 None] Acquiring lock "cinder-quobyte-52a4babb-72b7-41ba-a81f-7abb1b9a5246" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:52:54 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0926facc-7453-4c43-a993-165077c4e85e tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-quobyte-52a4babb-72b7-41ba-a81f-7abb1b9a5246" acquired by "delete_volume" :: waited 0.023s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:52:54 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[d593865b-bdc6-43d1-acb1-b5e0e4f25338]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:52:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0926facc-7453-4c43-a993-165077c4e85e tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-52a4babb-72b7-41ba-a81f-7abb1b9a5246 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:54 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-52a4babb-72b7-41ba-a81f-7abb1b9a5246 Sep 10 19:52:54 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:54 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0926facc-7453-4c43-a993-165077c4e85e tempest-VolumesDeleteCascade-2066102729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-52a4babb-72b7-41ba-a81f-7abb1b9a5246" returned: 0 in 0.452s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0926facc-7453-4c43-a993-165077c4e85e tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-52a4babb-72b7-41ba-a81f-7abb1b9a5246 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:54 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-52a4babb-72b7-41ba-a81f-7abb1b9a5246 Sep 10 19:52:54 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:55 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0926facc-7453-4c43-a993-165077c4e85e tempest-VolumesDeleteCascade-2066102729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-52a4babb-72b7-41ba-a81f-7abb1b9a5246" returned: 0 in 0.450s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:55 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0926facc-7453-4c43-a993-165077c4e85e tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-quobyte-52a4babb-72b7-41ba-a81f-7abb1b9a5246" released by "delete_volume" :: held 0.964s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:52:55 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-0926facc-7453-4c43-a993-165077c4e85e tempest-VolumesDeleteCascade-2066102729 None] Created reservations ['fcd83c14-922c-4981-bb5d-e201666bb081', '6453f83a-a2b6-4566-b717-4a6e2b5cb8fa', 'b77adb02-19f5-43c3-b889-f6751a0de066', 'fe207a52-4b73-472d-bc64-285a1ecb7013'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:52:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0926facc-7453-4c43-a993-165077c4e85e tempest-VolumesDeleteCascade-2066102729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:52:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0926facc-7453-4c43-a993-165077c4e85e tempest-VolumesDeleteCascade-2066102729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:52:55 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0926facc-7453-4c43-a993-165077c4e85e tempest-VolumesDeleteCascade-2066102729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:52:55 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0926facc-7453-4c43-a993-165077c4e85e tempest-VolumesDeleteCascade-2066102729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:52:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0926facc-7453-4c43-a993-165077c4e85e tempest-VolumesDeleteCascade-2066102729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:52:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0926facc-7453-4c43-a993-165077c4e85e tempest-VolumesDeleteCascade-2066102729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:52:55 devstack sudo[99660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:52:55 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:52:55 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root Sep 10 19:52:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0926facc-7453-4c43-a993-165077c4e85e tempest-VolumesDeleteCascade-2066102729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.271s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:52:55 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-0926facc-7453-4c43-a993-165077c4e85e tempest-VolumesDeleteCascade-2066102729 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:52:55 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-0926facc-7453-4c43-a993-165077c4e85e tempest-VolumesDeleteCascade-2066102729 None] Deleted volume successfully. Sep 10 19:52:55 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0926facc-7453-4c43-a993-165077c4e85e tempest-VolumesDeleteCascade-2066102729 None] Lock "cinder-52a4babb-72b7-41ba-a81f-7abb1b9a5246-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:53:03 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:53:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:53:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:53:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:03 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:53:03 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:04 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.574s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:04 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:53:04 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager._thread_info {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:53:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread count: 28 {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 19:53:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread info: [<_MainThread(MainThread, started 138417491665024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 19:53:04 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=141,cinder:UPDATE=166,cinder:INSERT=41,cinder:DELETE=12 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:53:04 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-f04e5730-00e1-408a-83e6-455a9ab0f692 tempest-GroupsTest-766275528 None] Group tempest-Group1-1646842113: creating Sep 10 19:53:04 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:53:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] Flow 'volume_create_manager' (d4875801-b01e-4341-b80b-b37a6940178b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:53:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d48f4ea-a34f-4e84-a5e0-e9144cc73e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d48f4ea-a34f-4e84-a5e0-e9144cc73e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-552114403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=355dbc16-784e-4a69-8cb5-afaac632accd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85bc47d6585740aa9349136b34a95830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:53:05Z,use_quota=True,user_id='aa81c42abb0f4dd39fdddc9dbf67b985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb3c076-cff8-4ad1-b674-e18a83c07212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb3c076-cff8-4ad1-b674-e18a83c07212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09aa3c0-f508-4592-ae7a-56dd34272b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09aa3c0-f508-4592-ae7a-56dd34272b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '355dbc16-784e-4a69-8cb5-afaac632accd', 'volume_name': 'volume-355dbc16-784e-4a69-8cb5-afaac632accd', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef812b5c-fc33-4930-ba1c-a9ed85ac6062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef812b5c-fc33-4930-ba1c-a9ed85ac6062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ffaf12-d7f4-4fbe-a8c1-c620618d2a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:04 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] Volume 355dbc16-784e-4a69-8cb5-afaac632accd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-355dbc16-784e-4a69-8cb5-afaac632accd', 'volume_size': 1} Sep 10 19:53:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-552114403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=355dbc16-784e-4a69-8cb5-afaac632accd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85bc47d6585740aa9349136b34a95830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:53:05Z,use_quota=True,user_id='aa81c42abb0f4dd39fdddc9dbf67b985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:53:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] Creating volume 355dbc16-784e-4a69-8cb5-afaac632accd {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:53:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:53:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:53:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:53:04 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:53:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-355dbc16-784e-4a69-8cb5-afaac632accd 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:04 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-355dbc16-784e-4a69-8cb5-afaac632accd 1073741824 Sep 10 19:53:04 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:04 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-f04e5730-00e1-408a-83e6-455a9ab0f692 tempest-GroupsTest-766275528 None] Group tempest-Group1-1646842113: created successfully Sep 10 19:53:04 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-f04e5730-00e1-408a-83e6-455a9ab0f692 tempest-GroupsTest-766275528 None] Create group completed successfully. Sep 10 19:53:05 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-355dbc16-784e-4a69-8cb5-afaac632accd 1073741824" returned: 0 in 0.646s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-355dbc16-784e-4a69-8cb5-afaac632accd {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:05 devstack sudo[99674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-355dbc16-784e-4a69-8cb5-afaac632accd Sep 10 19:53:05 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:05 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:53:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] Flow 'volume_create_manager' (90f9da84-37d9-4d8c-b6d6-3c9fa41b8be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:53:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22f2fbd0-3ef9-41bc-a197-cbfeed4888c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22f2fbd0-3ef9-41bc-a197-cbfeed4888c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1723172997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f4045be-b2dd-4fa7-8a1f-47020705438e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6018afa363d840d08f4b6c50c9b87e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:53:05Z,use_quota=True,user_id='65c2e12cc9f344e995ec3eec05138496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51aff05f-4efe-4ea4-b1a8-3503bf37ca52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51aff05f-4efe-4ea4-b1a8-3503bf37ca52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a687ac39-b109-4e5a-a80b-b65a8a676c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a687ac39-b109-4e5a-a80b-b65a8a676c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f4045be-b2dd-4fa7-8a1f-47020705438e', 'volume_name': 'volume-8f4045be-b2dd-4fa7-8a1f-47020705438e', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c9aa96c-faa5-423d-803d-af43df1e8a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c9aa96c-faa5-423d-803d-af43df1e8a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e06b11b4-68a5-4af1-9853-403c481d60fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:05 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] Volume 8f4045be-b2dd-4fa7-8a1f-47020705438e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f4045be-b2dd-4fa7-8a1f-47020705438e', 'volume_size': 1} Sep 10 19:53:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:05 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-355dbc16-784e-4a69-8cb5-afaac632accd" returned: 0 in 0.337s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:05 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-ad45c160-d78c-4adf-b852-e51aa31dd506 tempest-GroupsTest-766275528 None] Group tempest-Group2-2012583233: creating Sep 10 19:53:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:53:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.121s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1723172997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f4045be-b2dd-4fa7-8a1f-47020705438e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6018afa363d840d08f4b6c50c9b87e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:53:05Z,use_quota=True,user_id='65c2e12cc9f344e995ec3eec05138496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:53:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] Creating volume 8f4045be-b2dd-4fa7-8a1f-47020705438e {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:53:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:53:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:53:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:53:05 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:53:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:05 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e 1073741824 Sep 10 19:53:05 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ffaf12-d7f4-4fbe-a8c1-c620618d2a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-355dbc16-784e-4a69-8cb5-afaac632accd', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e45e684b-89f8-40ff-8467-76d2e8706f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:05 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-ad45c160-d78c-4adf-b852-e51aa31dd506 tempest-GroupsTest-766275528 None] Group tempest-Group2-2012583233: created successfully Sep 10 19:53:05 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] Volume volume-355dbc16-784e-4a69-8cb5-afaac632accd (355dbc16-784e-4a69-8cb5-afaac632accd): created successfully Sep 10 19:53:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e45e684b-89f8-40ff-8467-76d2e8706f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] Flow 'volume_create_manager' (d4875801-b01e-4341-b80b-b37a6940178b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:53:05 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-ad45c160-d78c-4adf-b852-e51aa31dd506 tempest-GroupsTest-766275528 None] Create group completed successfully. Sep 10 19:53:05 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-e18e4f3d-4350-48a8-bd6a-a2a48b17c914 tempest-VolumesMetadataTest-622216621 None] Created volume successfully. Sep 10 19:53:06 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e 1073741824" returned: 0 in 0.509s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:06 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e Sep 10 19:53:06 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:06 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e" returned: 0 in 0.256s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:06 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:53:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e06b11b4-68a5-4af1-9853-403c481d60fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f4045be-b2dd-4fa7-8a1f-47020705438e', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12439224-7977-421e-89cd-5e54c88bed57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:06 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] Volume volume-8f4045be-b2dd-4fa7-8a1f-47020705438e (8f4045be-b2dd-4fa7-8a1f-47020705438e): created successfully Sep 10 19:53:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12439224-7977-421e-89cd-5e54c88bed57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] Flow 'volume_create_manager' (90f9da84-37d9-4d8c-b6d6-3c9fa41b8be7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:53:06 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-e5c88467-69f9-454b-a270-c4d4a5f39a9a tempest-SnapshotDependencyTests-253338435 None] Created volume successfully. Sep 10 19:53:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d3e33e3a-694a-498c-b252-24b2e056a147 tempest-VolumesMetadataTest-622216621 None] Acquiring lock "cinder-355dbc16-784e-4a69-8cb5-afaac632accd-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:53:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d3e33e3a-694a-498c-b252-24b2e056a147 tempest-VolumesMetadataTest-622216621 None] Lock "cinder-355dbc16-784e-4a69-8cb5-afaac632accd-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:53:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d3e33e3a-694a-498c-b252-24b2e056a147 tempest-VolumesMetadataTest-622216621 None] Acquiring lock "cinder-quobyte-355dbc16-784e-4a69-8cb5-afaac632accd" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:53:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d3e33e3a-694a-498c-b252-24b2e056a147 tempest-VolumesMetadataTest-622216621 None] Lock "cinder-quobyte-355dbc16-784e-4a69-8cb5-afaac632accd" acquired by "delete_volume" :: waited 0.020s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:53:07 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[2365e11e-37dc-4dc3-b39a-fb7576662536]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:53:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d3e33e3a-694a-498c-b252-24b2e056a147 tempest-VolumesMetadataTest-622216621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-355dbc16-784e-4a69-8cb5-afaac632accd {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:07 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:53:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] Flow 'volume_create_manager' (b1c1b307-aa3d-472d-8743-b6529d24d158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:53:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ec24ca-edc8-4095-9465-fc773e35ebd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ec24ca-edc8-4095-9465-fc773e35ebd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1616552002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=786eb212-dcfc-49ca-8588-45f44d6d11b7,host='devstack@QuobyteHD#QuobyteHD',id=fc5fc97d-653d-4960-9b32-396b036b47f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34f7eb764b6412ca9322643a962b736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:53:08Z,use_quota=True,user_id='b0a76e90e32b41ebb48ccc7890510cce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b250c770-e883-41a1-96cb-ab6b8a364666),volume_type_id=b250c770-e883-41a1-96cb-ab6b8a364666)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2050323-67e4-48d8-80a9-cf490401ba35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2050323-67e4-48d8-80a9-cf490401ba35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6cecdb-4419-4a4d-8719-08bf9b74b43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6cecdb-4419-4a4d-8719-08bf9b74b43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc5fc97d-653d-4960-9b32-396b036b47f6', 'volume_name': 'volume-fc5fc97d-653d-4960-9b32-396b036b47f6', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dd7421a-391e-4f9d-9c8d-d6422ad4d7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:07 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-355dbc16-784e-4a69-8cb5-afaac632accd Sep 10 19:53:07 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dd7421a-391e-4f9d-9c8d-d6422ad4d7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ff4c0b-52bc-47c1-95f7-f40a490648a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:07 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] Volume fc5fc97d-653d-4960-9b32-396b036b47f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc5fc97d-653d-4960-9b32-396b036b47f6', 'volume_size': 1} Sep 10 19:53:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=786eb212-dcfc-49ca-8588-45f44d6d11b7,created_at=2026-09-10T17:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1616552002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=786eb212-dcfc-49ca-8588-45f44d6d11b7,host='devstack@QuobyteHD#QuobyteHD',id=fc5fc97d-653d-4960-9b32-396b036b47f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34f7eb764b6412ca9322643a962b736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:53:08Z,use_quota=True,user_id='b0a76e90e32b41ebb48ccc7890510cce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b250c770-e883-41a1-96cb-ab6b8a364666),volume_type_id=b250c770-e883-41a1-96cb-ab6b8a364666)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:53:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] Creating volume fc5fc97d-653d-4960-9b32-396b036b47f6 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:53:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:53:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:53:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:53:07 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:53:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-fc5fc97d-653d-4960-9b32-396b036b47f6 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:07 devstack sudo[99688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-fc5fc97d-653d-4960-9b32-396b036b47f6 1073741824 Sep 10 19:53:07 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6e9e4db0-b947-4beb-8f4b-78c5f0ae7f32 tempest-SnapshotDependencyTests-253338435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:08 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d3e33e3a-694a-498c-b252-24b2e056a147 tempest-VolumesMetadataTest-622216621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-355dbc16-784e-4a69-8cb5-afaac632accd" returned: 0 in 0.479s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d3e33e3a-694a-498c-b252-24b2e056a147 tempest-VolumesMetadataTest-622216621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-355dbc16-784e-4a69-8cb5-afaac632accd {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:08 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-355dbc16-784e-4a69-8cb5-afaac632accd Sep 10 19:53:08 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:08 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-fc5fc97d-653d-4960-9b32-396b036b47f6 1073741824" returned: 0 in 0.538s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-fc5fc97d-653d-4960-9b32-396b036b47f6 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:08 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d3e33e3a-694a-498c-b252-24b2e056a147 tempest-VolumesMetadataTest-622216621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-355dbc16-784e-4a69-8cb5-afaac632accd" returned: 0 in 0.293s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:08 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-fc5fc97d-653d-4960-9b32-396b036b47f6 Sep 10 19:53:08 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d3e33e3a-694a-498c-b252-24b2e056a147 tempest-VolumesMetadataTest-622216621 None] Lock "cinder-quobyte-355dbc16-784e-4a69-8cb5-afaac632accd" released by "delete_volume" :: held 0.842s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:53:08 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-d3e33e3a-694a-498c-b252-24b2e056a147 tempest-VolumesMetadataTest-622216621 None] Created reservations ['b42807c6-bdbf-473b-8ad2-c917acb76bcd', 'dd837fe8-bcec-4e82-b123-c8ffc5f48fb4', '6c946f5a-d40d-477b-9702-3b34a1052f94', 'b8cfc945-10fe-488c-aa60-62b765cbc147'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:53:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d3e33e3a-694a-498c-b252-24b2e056a147 tempest-VolumesMetadataTest-622216621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d3e33e3a-694a-498c-b252-24b2e056a147 tempest-VolumesMetadataTest-622216621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d3e33e3a-694a-498c-b252-24b2e056a147 tempest-VolumesMetadataTest-622216621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:53:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d3e33e3a-694a-498c-b252-24b2e056a147 tempest-VolumesMetadataTest-622216621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:53:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d3e33e3a-694a-498c-b252-24b2e056a147 tempest-VolumesMetadataTest-622216621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d3e33e3a-694a-498c-b252-24b2e056a147 tempest-VolumesMetadataTest-622216621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:08 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:53:08 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:08 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-fc5fc97d-653d-4960-9b32-396b036b47f6" returned: 0 in 0.298s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:53:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6e9e4db0-b947-4beb-8f4b-78c5f0ae7f32 tempest-SnapshotDependencyTests-253338435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.647s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-6e9e4db0-b947-4beb-8f4b-78c5f0ae7f32 tempest-SnapshotDependencyTests-253338435 None] Creating offline snapshot b1490488-3ead-4a67-9017-b4b0ba5dc0ee of volume 8f4045be-b2dd-4fa7-8a1f-47020705438e {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 19:53:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ff4c0b-52bc-47c1-95f7-f40a490648a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc5fc97d-653d-4960-9b32-396b036b47f6', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c6b8ca6-b312-40f0-b060-d594f33893ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:08 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad52d79-cef9-4fe5-afd7-e0a0c01534c9]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:53:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6e9e4db0-b947-4beb-8f4b-78c5f0ae7f32 tempest-SnapshotDependencyTests-253338435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:08 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] Volume volume-fc5fc97d-653d-4960-9b32-396b036b47f6 (fc5fc97d-653d-4960-9b32-396b036b47f6): created successfully Sep 10 19:53:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c6b8ca6-b312-40f0-b060-d594f33893ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] Flow 'volume_create_manager' (b1c1b307-aa3d-472d-8743-b6529d24d158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:53:08 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-5e830a6e-873d-41a0-9884-b3df034ccb44 tempest-GroupsTest-766275528 None] Created volume successfully. Sep 10 19:53:08 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d3e33e3a-694a-498c-b252-24b2e056a147 tempest-VolumesMetadataTest-622216621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.406s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:08 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-d3e33e3a-694a-498c-b252-24b2e056a147 tempest-VolumesMetadataTest-622216621 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:53:08 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-d3e33e3a-694a-498c-b252-24b2e056a147 tempest-VolumesMetadataTest-622216621 None] Deleted volume successfully. Sep 10 19:53:09 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d3e33e3a-694a-498c-b252-24b2e056a147 tempest-VolumesMetadataTest-622216621 None] Lock "cinder-355dbc16-784e-4a69-8cb5-afaac632accd-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:53:09 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e Sep 10 19:53:09 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:09 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6e9e4db0-b947-4beb-8f4b-78c5f0ae7f32 tempest-SnapshotDependencyTests-253338435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e" returned: 0 in 0.676s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6e9e4db0-b947-4beb-8f4b-78c5f0ae7f32 tempest-SnapshotDependencyTests-253338435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e.b1490488-3ead-4a67-9017-b4b0ba5dc0ee 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:09 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e.b1490488-3ead-4a67-9017-b4b0ba5dc0ee 1G Sep 10 19:53:09 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:09 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6e9e4db0-b947-4beb-8f4b-78c5f0ae7f32 tempest-SnapshotDependencyTests-253338435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e.b1490488-3ead-4a67-9017-b4b0ba5dc0ee 1G" returned: 0 in 0.478s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6e9e4db0-b947-4beb-8f4b-78c5f0ae7f32 tempest-SnapshotDependencyTests-253338435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f4045be-b2dd-4fa7-8a1f-47020705438e -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e.b1490488-3ead-4a67-9017-b4b0ba5dc0ee {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:09 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f4045be-b2dd-4fa7-8a1f-47020705438e -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e.b1490488-3ead-4a67-9017-b4b0ba5dc0ee Sep 10 19:53:09 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:10 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6e9e4db0-b947-4beb-8f4b-78c5f0ae7f32 tempest-SnapshotDependencyTests-253338435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f4045be-b2dd-4fa7-8a1f-47020705438e -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e.b1490488-3ead-4a67-9017-b4b0ba5dc0ee" returned: 0 in 0.420s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:10 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-6e9e4db0-b947-4beb-8f4b-78c5f0ae7f32 tempest-SnapshotDependencyTests-253338435 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e.b1490488-3ead-4a67-9017-b4b0ba5dc0ee is being set with open permissions: ugo+rw Sep 10 19:53:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6e9e4db0-b947-4beb-8f4b-78c5f0ae7f32 tempest-SnapshotDependencyTests-253338435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e.b1490488-3ead-4a67-9017-b4b0ba5dc0ee {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:10 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e.b1490488-3ead-4a67-9017-b4b0ba5dc0ee Sep 10 19:53:10 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:10 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6e9e4db0-b947-4beb-8f4b-78c5f0ae7f32 tempest-SnapshotDependencyTests-253338435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e.b1490488-3ead-4a67-9017-b4b0ba5dc0ee" returned: 0 in 0.360s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6e9e4db0-b947-4beb-8f4b-78c5f0ae7f32 tempest-SnapshotDependencyTests-253338435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:10 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e.info Sep 10 19:53:10 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:11 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6e9e4db0-b947-4beb-8f4b-78c5f0ae7f32 tempest-SnapshotDependencyTests-253338435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e.info" returned: 0 in 0.406s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:11 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-6e9e4db0-b947-4beb-8f4b-78c5f0ae7f32 tempest-SnapshotDependencyTests-253338435 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e.info is being set with open permissions: ugo+rw Sep 10 19:53:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6e9e4db0-b947-4beb-8f4b-78c5f0ae7f32 tempest-SnapshotDependencyTests-253338435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:11 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e.info Sep 10 19:53:11 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-fc2918f4-1aa0-4e2e-8670-f4e7f8c68260 tempest-GroupsTest-766275528 None] Acquiring lock "cinder-quobyte-fc5fc97d-653d-4960-9b32-396b036b47f6" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:53:11 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:11 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-fc2918f4-1aa0-4e2e-8670-f4e7f8c68260 tempest-GroupsTest-766275528 None] Lock "cinder-quobyte-fc5fc97d-653d-4960-9b32-396b036b47f6" acquired by "delete_volume" :: waited 0.029s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:53:11 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fba3c9f-b7c0-4468-ba43-bcec4ab94b1d]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:53:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fc2918f4-1aa0-4e2e-8670-f4e7f8c68260 tempest-GroupsTest-766275528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-fc5fc97d-653d-4960-9b32-396b036b47f6 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:11 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-fc5fc97d-653d-4960-9b32-396b036b47f6 Sep 10 19:53:11 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:11 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6e9e4db0-b947-4beb-8f4b-78c5f0ae7f32 tempest-SnapshotDependencyTests-253338435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e.info" returned: 0 in 0.321s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6e9e4db0-b947-4beb-8f4b-78c5f0ae7f32 tempest-SnapshotDependencyTests-253338435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.838s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:11 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-6e9e4db0-b947-4beb-8f4b-78c5f0ae7f32 tempest-SnapshotDependencyTests-253338435 None] Create snapshot completed successfully Sep 10 19:53:11 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fc2918f4-1aa0-4e2e-8670-f4e7f8c68260 tempest-GroupsTest-766275528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-fc5fc97d-653d-4960-9b32-396b036b47f6" returned: 0 in 0.510s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fc2918f4-1aa0-4e2e-8670-f4e7f8c68260 tempest-GroupsTest-766275528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-fc5fc97d-653d-4960-9b32-396b036b47f6 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:11 devstack sudo[99737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-fc5fc97d-653d-4960-9b32-396b036b47f6 Sep 10 19:53:11 devstack sudo[99737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:12 devstack sudo[99737]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fc2918f4-1aa0-4e2e-8670-f4e7f8c68260 tempest-GroupsTest-766275528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-fc5fc97d-653d-4960-9b32-396b036b47f6" returned: 0 in 0.345s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:12 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-fc2918f4-1aa0-4e2e-8670-f4e7f8c68260 tempest-GroupsTest-766275528 None] Lock "cinder-quobyte-fc5fc97d-653d-4960-9b32-396b036b47f6" released by "delete_volume" :: held 0.921s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:53:12 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-fc2918f4-1aa0-4e2e-8670-f4e7f8c68260 tempest-GroupsTest-766275528 None] Created reservations ['cfbc1b41-547b-4221-968b-c1973504a77b'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:53:12 devstack cinder-volume[88093]: WARNING cinder.quota [None req-fc2918f4-1aa0-4e2e-8670-f4e7f8c68260 tempest-GroupsTest-766275528 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-246763955 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-246763955, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:53:12 devstack cinder-volume[88093]: WARNING cinder.quota [None req-fc2918f4-1aa0-4e2e-8670-f4e7f8c68260 tempest-GroupsTest-766275528 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-246763955 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-246763955, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:53:12 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-fc2918f4-1aa0-4e2e-8670-f4e7f8c68260 tempest-GroupsTest-766275528 None] Created reservations ['fa46f33a-0be6-4ba7-b09b-8cf323dfaefd', '081f9ce4-adf3-48bb-a511-f9f0366ee135', '807f5ed0-530e-49e6-8af6-5af79bcb353c', 'b9968a53-1de2-400a-91b9-55098dbf5573'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:53:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-fc2918f4-1aa0-4e2e-8670-f4e7f8c68260 tempest-GroupsTest-766275528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-fc2918f4-1aa0-4e2e-8670-f4e7f8c68260 tempest-GroupsTest-766275528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:12 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-fc2918f4-1aa0-4e2e-8670-f4e7f8c68260 tempest-GroupsTest-766275528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:53:12 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-fc2918f4-1aa0-4e2e-8670-f4e7f8c68260 tempest-GroupsTest-766275528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:53:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-fc2918f4-1aa0-4e2e-8670-f4e7f8c68260 tempest-GroupsTest-766275528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fc2918f4-1aa0-4e2e-8670-f4e7f8c68260 tempest-GroupsTest-766275528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:12 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:53:12 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:12 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fc2918f4-1aa0-4e2e-8670-f4e7f8c68260 tempest-GroupsTest-766275528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.360s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:12 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-fc2918f4-1aa0-4e2e-8670-f4e7f8c68260 tempest-GroupsTest-766275528 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:53:12 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-fc2918f4-1aa0-4e2e-8670-f4e7f8c68260 tempest-GroupsTest-766275528 None] Delete group completed successfully. Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Flow 'volume_create_manager' (62c32686-0bd1-41a5-bfec-fe081b599780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7489a66c-ab91-4461-8823-b96148c9be11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7489a66c-ab91-4461-8823-b96148c9be11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=527d1519-05ef-4a84-84e9-044d78822bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6018afa363d840d08f4b6c50c9b87e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b1490488-3ead-4a67-9017-b4b0ba5dc0ee,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:53:13Z,use_quota=True,user_id='65c2e12cc9f344e995ec3eec05138496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a084703b-fcf5-4b80-937f-d8f1717aa31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a084703b-fcf5-4b80-937f-d8f1717aa31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7e2a46-94ce-40b5-a939-32ffdb7d0ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7e2a46-94ce-40b5-a939-32ffdb7d0ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '527d1519-05ef-4a84-84e9-044d78822bc6', 'volume_name': 'volume-527d1519-05ef-4a84-84e9-044d78822bc6', 'volume_size': 1, 'snapshot_id': 'b1490488-3ead-4a67-9017-b4b0ba5dc0ee'}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c0b197-3900-4755-af44-384ecb2c96fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c0b197-3900-4755-af44-384ecb2c96fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d2469c-0742-4bc1-9167-f5a05cacb818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:13 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Volume 527d1519-05ef-4a84-84e9-044d78822bc6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-527d1519-05ef-4a84-84e9-044d78822bc6', 'volume_size': 1, 'snapshot_id': 'b1490488-3ead-4a67-9017-b4b0ba5dc0ee'} Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Acquiring lock "cinder-quobyte-b1490488-3ead-4a67-9017-b4b0ba5dc0ee-527d1519-05ef-4a84-84e9-044d78822bc6" by "_create_volume_from_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Lock "cinder-quobyte-b1490488-3ead-4a67-9017-b4b0ba5dc0ee-527d1519-05ef-4a84-84e9-044d78822bc6" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Creating volume 527d1519-05ef-4a84-84e9-044d78822bc6 from snapshot b1490488-3ead-4a67-9017-b4b0ba5dc0ee {{(pid=88093) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Acquiring lock "cinder-quobyte-527d1519-05ef-4a84-84e9-044d78822bc6" by "_copy_volume_from_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Lock "cinder-quobyte-527d1519-05ef-4a84-84e9-044d78822bc6" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] snapshot: b1490488-3ead-4a67-9017-b4b0ba5dc0ee, volume: 527d1519-05ef-4a84-84e9-044d78822bc6, {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f73c2ee-5db0-4239-8b62-19103f66c83f]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e.b1490488-3ead-4a67-9017-b4b0ba5dc0ee {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:13 devstack sudo[99743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e.b1490488-3ead-4a67-9017-b4b0ba5dc0ee Sep 10 19:53:13 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:13 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-0c962371-658c-4487-a20a-229ce8877eaa tempest-GroupsTest-766275528 None] Created reservations ['db1108b2-7e02-45ab-86da-6654aa84a317'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:53:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0c962371-658c-4487-a20a-229ce8877eaa tempest-GroupsTest-766275528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0c962371-658c-4487-a20a-229ce8877eaa tempest-GroupsTest-766275528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0c962371-658c-4487-a20a-229ce8877eaa tempest-GroupsTest-766275528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:53:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0c962371-658c-4487-a20a-229ce8877eaa tempest-GroupsTest-766275528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:53:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0c962371-658c-4487-a20a-229ce8877eaa tempest-GroupsTest-766275528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0c962371-658c-4487-a20a-229ce8877eaa tempest-GroupsTest-766275528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:14 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:53:14 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:14 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e.b1490488-3ead-4a67-9017-b4b0ba5dc0ee" returned: 0 in 0.481s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f4045be-b2dd-4fa7-8a1f-47020705438e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:53:14 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b02e74-86c9-49c2-a4e4-cd8129655c7d]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:53:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:14 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e Sep 10 19:53:14 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:14 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0c962371-658c-4487-a20a-229ce8877eaa tempest-GroupsTest-766275528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.591s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:14 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-0c962371-658c-4487-a20a-229ce8877eaa tempest-GroupsTest-766275528 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:53:14 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-0c962371-658c-4487-a20a-229ce8877eaa tempest-GroupsTest-766275528 None] Delete group completed successfully. Sep 10 19:53:14 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e" returned: 0 in 0.538s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 19:53:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Creating direct copy from snapshot {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 19:53:14 devstack cinder-volume[88093]: DEBUG cinder.utils [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Path /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-527d1519-05ef-4a84-84e9-044d78822bc6 not found in is_blk_device check {{(pid=88093) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 19:53:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-527d1519-05ef-4a84-84e9-044d78822bc6 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:14 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-527d1519-05ef-4a84-84e9-044d78822bc6 Sep 10 19:53:14 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:14 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:53:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Flow 'volume_create_manager' (5faf17aa-839d-4e1d-98df-236ecdcca3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:53:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc39f1d-7531-4e22-b71b-f908ebcec6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc39f1d-7531-4e22-b71b-f908ebcec6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1990423863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a28adc65-e365-46a9-8e24-c5ce969074bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68b81a66a8b5462c81ff9f16c8ce643d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:53:15Z,use_quota=True,user_id='ca3e7c312c7246e499e2d7b8a5628d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0990d118-2cc6-4451-bc39-baa0536fb052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0990d118-2cc6-4451-bc39-baa0536fb052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d09d07f-d5e9-4157-bd89-4caa4c60cdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:15 devstack cinder-volume[88093]: DEBUG cinder.image.glance [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Creating Keystone auth plugin from conf {{(pid=88093) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 19:53:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d09d07f-d5e9-4157-bd89-4caa4c60cdb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a28adc65-e365-46a9-8e24-c5ce969074bf', 'volume_name': 'volume-a28adc65-e365-46a9-8e24-c5ce969074bf', 'volume_size': 1, 'image_id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cce253731714c6797a2e9bce91009cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'created_at': datetime.datetime(2026, 9, 10, 17, 35, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 35, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (109efa0a-37f5-4e68-82f7-6a5889ca4418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (109efa0a-37f5-4e68-82f7-6a5889ca4418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (485e5e02-20d7-4c08-abeb-984e3173bded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:15 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Volume a28adc65-e365-46a9-8e24-c5ce969074bf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a28adc65-e365-46a9-8e24-c5ce969074bf', 'volume_size': 1, 'image_id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cce253731714c6797a2e9bce91009cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'created_at': datetime.datetime(2026, 9, 10, 17, 35, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 35, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 19:53:15 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Trying to clone a28adc65-e365-46a9-8e24-c5ce969074bf from image ce7b5bdf-521a-42b1-b62b-e8406ccf342b at location (None, [{'url': 'file:///opt/stack/data/glance/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'metadata': {}}]). {{(pid=88093) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 19:53:16 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-60e5015a-d4bb-4568-821b-a1dd6addd44f tempest-GroupsTest-766275528 None] Group tempest-GroupsTest-Group-1054266124: creating Sep 10 19:53:16 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-60e5015a-d4bb-4568-821b-a1dd6addd44f tempest-GroupsTest-766275528 None] Group tempest-GroupsTest-Group-1054266124: created successfully Sep 10 19:53:16 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-60e5015a-d4bb-4568-821b-a1dd6addd44f tempest-GroupsTest-766275528 None] Create group completed successfully. Sep 10 19:53:16 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_wmx8fmg9devstack@QuobyteHD, size 20.69 MB, duration 1.04 sec {{(pid=88093) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 19:53:16 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Image download 20.69 MB at 19.82 MB/s Sep 10 19:53:16 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7ecd41-5e61-4c4c-a97e-3146222d2280]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:53:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_wmx8fmg9devstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:17 devstack sudo[99770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_wmx8fmg9devstack@QuobyteHD Sep 10 19:53:17 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:17 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_wmx8fmg9devstack@QuobyteHD" returned: 0 in 0.970s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:17 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Temporary image ce7b5bdf-521a-42b1-b62b-e8406ccf342b is fetched for user ca3e7c312c7246e499e2d7b8a5628d09. {{(pid=88093) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 19:53:18 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d755e9b-4c28-49cd-90d4-ae968d0a7b5a]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:53:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_wmx8fmg9devstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:18 devstack sudo[99776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_wmx8fmg9devstack@QuobyteHD Sep 10 19:53:18 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:18 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_wmx8fmg9devstack@QuobyteHD" returned: 0 in 0.712s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:19 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:53:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] Flow 'volume_create_manager' (33314638-530b-404e-8659-4734071636bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:53:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa9be4d-b6e5-4da9-adbd-5d4f2041704e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa9be4d-b6e5-4da9-adbd-5d4f2041704e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1771604573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=59410c77-60e8-43b4-9ff7-b4ced5c4d509,host='devstack@QuobyteHD#QuobyteHD',id=044f2b6c-4320-46b1-a0ef-459cb63e5540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34f7eb764b6412ca9322643a962b736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:53:19Z,use_quota=True,user_id='b0a76e90e32b41ebb48ccc7890510cce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fe528c8-0c75-44b3-91b2-c71f91dc29b5),volume_type_id=9fe528c8-0c75-44b3-91b2-c71f91dc29b5)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d5455b-7921-4bd6-a5c1-2c1f7e21e227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d5455b-7921-4bd6-a5c1-2c1f7e21e227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf24ea59-6189-41dc-8d0a-48e5f9bc6b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf24ea59-6189-41dc-8d0a-48e5f9bc6b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '044f2b6c-4320-46b1-a0ef-459cb63e5540', 'volume_name': 'volume-044f2b6c-4320-46b1-a0ef-459cb63e5540', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d0f68f-0a73-4706-af6a-11c0585b1265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d0f68f-0a73-4706-af6a-11c0585b1265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2efb3c7e-3e08-4cc2-9148-1d41b5e76c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:19 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] Volume 044f2b6c-4320-46b1-a0ef-459cb63e5540: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-044f2b6c-4320-46b1-a0ef-459cb63e5540', 'volume_size': 1} Sep 10 19:53:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:21 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-527d1519-05ef-4a84-84e9-044d78822bc6" returned: 0 in 6.692s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Image conversion details: src /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e, size 1024.00 MB, duration 6.69 sec, destination /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-527d1519-05ef-4a84-84e9-044d78822bc6 {{(pid=88093) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 19:53:21 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Converted 1024.00 MB image at 153.00 MB/s Sep 10 19:53:21 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-527d1519-05ef-4a84-84e9-044d78822bc6 is being set with open permissions: ugo+rw Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-527d1519-05ef-4a84-84e9-044d78822bc6 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:21 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-527d1519-05ef-4a84-84e9-044d78822bc6 Sep 10 19:53:21 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] Flow 'volume_create_manager' (25507e56-649b-4e1c-ac36-33cc263910a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c6adb2-2627-419c-8ebc-3526abbcf5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c6adb2-2627-419c-8ebc-3526abbcf5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1235080791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a940d3f-ef07-472a-8ba1-f59a1c076d43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e80af9253d24d6182665ecf900e7328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:53:22Z,use_quota=True,user_id='fcda84efdf194805a8f20fc4feeeb60d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12275703-2944-427d-8778-8b75e5e04898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12275703-2944-427d-8778-8b75e5e04898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc37586c-9e3a-477e-a7dd-4f7d4c0592ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc37586c-9e3a-477e-a7dd-4f7d4c0592ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a940d3f-ef07-472a-8ba1-f59a1c076d43', 'volume_name': 'volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d8ffbe-3ddd-4fb7-8809-171f634d1c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d8ffbe-3ddd-4fb7-8809-171f634d1c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4836999-1485-432f-b117-ca251eec8a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:21 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] Volume 5a940d3f-ef07-472a-8ba1-f59a1c076d43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43', 'volume_size': 1} Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:21 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-527d1519-05ef-4a84-84e9-044d78822bc6" returned: 0 in 0.282s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Lock "cinder-quobyte-527d1519-05ef-4a84-84e9-044d78822bc6" released by "_copy_volume_from_snapshot" :: held 8.107s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Lock "cinder-quobyte-b1490488-3ead-4a67-9017-b4b0ba5dc0ee-527d1519-05ef-4a84-84e9-044d78822bc6" released by "_create_volume_from_snapshot" :: held 8.215s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.239s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.941s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1990423863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a28adc65-e365-46a9-8e24-c5ce969074bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68b81a66a8b5462c81ff9f16c8ce643d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:53:15Z,use_quota=True,user_id='ca3e7c312c7246e499e2d7b8a5628d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Creating volume a28adc65-e365-46a9-8e24-c5ce969074bf {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:53:21 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a28adc65-e365-46a9-8e24-c5ce969074bf 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:21 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a28adc65-e365-46a9-8e24-c5ce969074bf 1073741824 Sep 10 19:53:21 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d2469c-0742-4bc1-9167-f5a05cacb818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-527d1519-05ef-4a84-84e9-044d78822bc6', 'volume_size': 1, 'snapshot_id': 'b1490488-3ead-4a67-9017-b4b0ba5dc0ee'}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86344de1-8529-4db9-8330-d7a60a71878e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:21 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Volume volume-527d1519-05ef-4a84-84e9-044d78822bc6 (527d1519-05ef-4a84-84e9-044d78822bc6): created successfully Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86344de1-8529-4db9-8330-d7a60a71878e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Flow 'volume_create_manager' (62c32686-0bd1-41a5-bfec-fe081b599780) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:53:21 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-3104af89-48ba-4b30-bd98-cfd465491122 tempest-SnapshotDependencyTests-253338435 None] Created volume successfully. Sep 10 19:53:22 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a28adc65-e365-46a9-8e24-c5ce969074bf 1073741824" returned: 0 in 0.448s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a28adc65-e365-46a9-8e24-c5ce969074bf {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:22 devstack sudo[99794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a28adc65-e365-46a9-8e24-c5ce969074bf Sep 10 19:53:22 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:22 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a28adc65-e365-46a9-8e24-c5ce969074bf" returned: 0 in 0.258s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:22 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:53:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.066s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:22 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=59410c77-60e8-43b4-9ff7-b4ced5c4d509,created_at=2026-09-10T17:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1771604573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=59410c77-60e8-43b4-9ff7-b4ced5c4d509,host='devstack@QuobyteHD#QuobyteHD',id=044f2b6c-4320-46b1-a0ef-459cb63e5540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34f7eb764b6412ca9322643a962b736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:53:19Z,use_quota=True,user_id='b0a76e90e32b41ebb48ccc7890510cce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fe528c8-0c75-44b3-91b2-c71f91dc29b5),volume_type_id=9fe528c8-0c75-44b3-91b2-c71f91dc29b5)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:53:22 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] Creating volume 044f2b6c-4320-46b1-a0ef-459cb63e5540 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:53:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:22 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:53:22 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:53:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:22 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:53:22 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:53:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-044f2b6c-4320-46b1-a0ef-459cb63e5540 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:22 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-044f2b6c-4320-46b1-a0ef-459cb63e5540 1073741824 Sep 10 19:53:22 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:22 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1f30c311-e8e9-4ea2-944d-80ac2b5b7328 tempest-SnapshotDependencyTests-253338435 None] Acquiring lock "cinder-b1490488-3ead-4a67-9017-b4b0ba5dc0ee-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:53:22 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1f30c311-e8e9-4ea2-944d-80ac2b5b7328 tempest-SnapshotDependencyTests-253338435 None] Lock "cinder-b1490488-3ead-4a67-9017-b4b0ba5dc0ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:53:22 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1f30c311-e8e9-4ea2-944d-80ac2b5b7328 tempest-SnapshotDependencyTests-253338435 None] Acquiring lock "cinder-quobyte-8f4045be-b2dd-4fa7-8a1f-47020705438e" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:53:22 devstack cinder-volume[88093]: DEBUG cinder.volume.volume_utils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Attempting download of ce7b5bdf-521a-42b1-b62b-e8406ccf342b ((None, [{'url': 'file:///opt/stack/data/glance/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'metadata': {}}])) to volume a28adc65-e365-46a9-8e24-c5ce969074bf. {{(pid=88093) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 19:53:22 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1f30c311-e8e9-4ea2-944d-80ac2b5b7328 tempest-SnapshotDependencyTests-253338435 None] Lock "cinder-quobyte-8f4045be-b2dd-4fa7-8a1f-47020705438e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:53:22 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1f30c311-e8e9-4ea2-944d-80ac2b5b7328 tempest-SnapshotDependencyTests-253338435 None] Acquiring lock "cinder-quobyte-b1490488-3ead-4a67-9017-b4b0ba5dc0ee" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:53:22 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1f30c311-e8e9-4ea2-944d-80ac2b5b7328 tempest-SnapshotDependencyTests-253338435 None] Lock "cinder-quobyte-b1490488-3ead-4a67-9017-b4b0ba5dc0ee" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:53:22 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-1f30c311-e8e9-4ea2-944d-80ac2b5b7328 tempest-SnapshotDependencyTests-253338435 None] Deleting offline snapshot b1490488-3ead-4a67-9017-b4b0ba5dc0ee of volume 8f4045be-b2dd-4fa7-8a1f-47020705438e {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 19:53:22 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-1f30c311-e8e9-4ea2-944d-80ac2b5b7328 tempest-SnapshotDependencyTests-253338435 None] snapshot_file for this snap is: volume-8f4045be-b2dd-4fa7-8a1f-47020705438e.b1490488-3ead-4a67-9017-b4b0ba5dc0ee {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 19:53:22 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d5aa3c-db87-4d41-b54e-05296f6e84d6]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:53:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1f30c311-e8e9-4ea2-944d-80ac2b5b7328 tempest-SnapshotDependencyTests-253338435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e.b1490488-3ead-4a67-9017-b4b0ba5dc0ee {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:22 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e78ee0-1ba3-4c85-bf7f-7d8b711d43bf]: (4, 'raw') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:53:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_8dn9vn61 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:22 devstack sudo[99799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e.b1490488-3ead-4a67-9017-b4b0ba5dc0ee Sep 10 19:53:22 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:22 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_8dn9vn61 Sep 10 19:53:22 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:23 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1f30c311-e8e9-4ea2-944d-80ac2b5b7328 tempest-SnapshotDependencyTests-253338435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e.b1490488-3ead-4a67-9017-b4b0ba5dc0ee" returned: 0 in 0.385s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-1f30c311-e8e9-4ea2-944d-80ac2b5b7328 tempest-SnapshotDependencyTests-253338435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f4045be-b2dd-4fa7-8a1f-47020705438e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:53:23 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:23 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-044f2b6c-4320-46b1-a0ef-459cb63e5540 1073741824" returned: 0 in 0.542s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_8dn9vn61" returned: 0 in 0.395s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_8dn9vn61 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5ae4c3-c17b-4690-b0b8-cd11a8366028]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1f30c311-e8e9-4ea2-944d-80ac2b5b7328 tempest-SnapshotDependencyTests-253338435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-044f2b6c-4320-46b1-a0ef-459cb63e5540 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:23 devstack sudo[99813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-044f2b6c-4320-46b1-a0ef-459cb63e5540 Sep 10 19:53:23 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:23 devstack sudo[99811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_8dn9vn61 Sep 10 19:53:23 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:23 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e Sep 10 19:53:23 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:23 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-044f2b6c-4320-46b1-a0ef-459cb63e5540" returned: 0 in 0.255s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.812s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1235080791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a940d3f-ef07-472a-8ba1-f59a1c076d43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e80af9253d24d6182665ecf900e7328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:53:22Z,use_quota=True,user_id='fcda84efdf194805a8f20fc4feeeb60d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] Creating volume 5a940d3f-ef07-472a-8ba1-f59a1c076d43 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:53:23 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:53:23 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_8dn9vn61" returned: 1 in 0.346s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_8dn9vn61' failed. Not Retrying. {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[5000f6e8-6182-4df0-af41-42c13c5c7d39]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_wmx8fmg9devstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:23 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43 1073741824 Sep 10 19:53:23 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2efb3c7e-3e08-4cc2-9148-1d41b5e76c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-044f2b6c-4320-46b1-a0ef-459cb63e5540', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7758d7bf-a0b8-49e1-8e43-520eb20bee10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:23 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] Volume volume-044f2b6c-4320-46b1-a0ef-459cb63e5540 (044f2b6c-4320-46b1-a0ef-459cb63e5540): created successfully Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7758d7bf-a0b8-49e1-8e43-520eb20bee10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] Flow 'volume_create_manager' (33314638-530b-404e-8659-4734071636bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:53:23 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-3343f1cb-87c2-4127-a449-0cedc474aebc tempest-GroupsTest-766275528 None] Created volume successfully. Sep 10 19:53:23 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_wmx8fmg9devstack@QuobyteHD Sep 10 19:53:23 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:23 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1f30c311-e8e9-4ea2-944d-80ac2b5b7328 tempest-SnapshotDependencyTests-253338435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e" returned: 0 in 0.570s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1f30c311-e8e9-4ea2-944d-80ac2b5b7328 tempest-SnapshotDependencyTests-253338435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e.b1490488-3ead-4a67-9017-b4b0ba5dc0ee {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:23 devstack sudo[99829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e.b1490488-3ead-4a67-9017-b4b0ba5dc0ee Sep 10 19:53:23 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:23 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_wmx8fmg9devstack@QuobyteHD" returned: 0 in 0.437s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] ce7b5bdf-521a-42b1-b62b-e8406ccf342b was qcow2, converting to qcow2 {{(pid=88093) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_wmx8fmg9devstack@QuobyteHD /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a28adc65-e365-46a9-8e24-c5ce969074bf {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:23 devstack sudo[99836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_wmx8fmg9devstack@QuobyteHD /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a28adc65-e365-46a9-8e24-c5ce969074bf Sep 10 19:53:23 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:23 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43 1073741824" returned: 0 in 0.491s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:24 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43 Sep 10 19:53:24 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:24 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1f30c311-e8e9-4ea2-944d-80ac2b5b7328 tempest-SnapshotDependencyTests-253338435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e.b1490488-3ead-4a67-9017-b4b0ba5dc0ee" returned: 0 in 0.435s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1f30c311-e8e9-4ea2-944d-80ac2b5b7328 tempest-SnapshotDependencyTests-253338435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e.b1490488-3ead-4a67-9017-b4b0ba5dc0ee {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:24 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e.b1490488-3ead-4a67-9017-b4b0ba5dc0ee Sep 10 19:53:24 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:24 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43" returned: 0 in 0.314s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:24 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:53:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:24 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4836999-1485-432f-b117-ca251eec8a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:24 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624b3e4d-751a-4f24-a03c-15f8bcf8e779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:24 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] Volume volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43 (5a940d3f-ef07-472a-8ba1-f59a1c076d43): created successfully Sep 10 19:53:24 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624b3e4d-751a-4f24-a03c-15f8bcf8e779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:24 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] Flow 'volume_create_manager' (25507e56-649b-4e1c-ac36-33cc263910a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:53:24 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-ffbe44bc-ddc4-4235-b40d-6e803d8da121 tempest-VolumesActionsTest-1568259041 None] Created volume successfully. Sep 10 19:53:24 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1f30c311-e8e9-4ea2-944d-80ac2b5b7328 tempest-SnapshotDependencyTests-253338435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e.b1490488-3ead-4a67-9017-b4b0ba5dc0ee" returned: 0 in 0.280s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:24 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1f30c311-e8e9-4ea2-944d-80ac2b5b7328 tempest-SnapshotDependencyTests-253338435 None] Lock "cinder-quobyte-b1490488-3ead-4a67-9017-b4b0ba5dc0ee" released by "_delete_snapshot" :: held 1.802s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:53:24 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1f30c311-e8e9-4ea2-944d-80ac2b5b7328 tempest-SnapshotDependencyTests-253338435 None] Lock "cinder-quobyte-8f4045be-b2dd-4fa7-8a1f-47020705438e" released by "delete_snapshot" :: held 1.830s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:53:24 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-1f30c311-e8e9-4ea2-944d-80ac2b5b7328 tempest-SnapshotDependencyTests-253338435 None] Created reservations ['a5bb660e-f2a2-4f09-8376-155f65d2a3ef', '097947d5-abac-449c-8897-afac84e34596', '3fbf83c6-b728-4b37-aa2e-50c89388c650', '398dc5a2-4b86-419b-83fd-1348d2aac4ca'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:53:24 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-1f30c311-e8e9-4ea2-944d-80ac2b5b7328 tempest-SnapshotDependencyTests-253338435 None] Delete snapshot completed successfully. Sep 10 19:53:24 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1f30c311-e8e9-4ea2-944d-80ac2b5b7328 tempest-SnapshotDependencyTests-253338435 None] Lock "cinder-b1490488-3ead-4a67-9017-b4b0ba5dc0ee-delete_snapshot" released by "delete_snapshot" :: held 2.020s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:53:24 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0bcdc32b-a631-4ef8-bb75-780ae80ef1cf tempest-SnapshotDependencyTests-253338435 None] Acquiring lock "cinder-8f4045be-b2dd-4fa7-8a1f-47020705438e-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:53:24 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0bcdc32b-a631-4ef8-bb75-780ae80ef1cf tempest-SnapshotDependencyTests-253338435 None] Lock "cinder-8f4045be-b2dd-4fa7-8a1f-47020705438e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:53:24 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0bcdc32b-a631-4ef8-bb75-780ae80ef1cf tempest-SnapshotDependencyTests-253338435 None] Acquiring lock "cinder-quobyte-8f4045be-b2dd-4fa7-8a1f-47020705438e" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:53:24 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0bcdc32b-a631-4ef8-bb75-780ae80ef1cf tempest-SnapshotDependencyTests-253338435 None] Lock "cinder-quobyte-8f4045be-b2dd-4fa7-8a1f-47020705438e" acquired by "delete_volume" :: waited 0.028s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:53:25 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bd4055-bfae-43e0-9fb0-dcf6bcbc3183]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:53:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0bcdc32b-a631-4ef8-bb75-780ae80ef1cf tempest-SnapshotDependencyTests-253338435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:25 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:53:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] Flow 'volume_create_manager' (ed4edcae-a8c1-40f3-a39a-d132673062bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:53:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2f4201-7725-4e26-a497-1b4ff764d05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2f4201-7725-4e26-a497-1b4ff764d05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-806661118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=59410c77-60e8-43b4-9ff7-b4ced5c4d509,host='devstack@QuobyteHD#QuobyteHD',id=67b9dcb5-b365-405a-8b73-a045bb08ed70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34f7eb764b6412ca9322643a962b736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:53:25Z,use_quota=True,user_id='b0a76e90e32b41ebb48ccc7890510cce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fe528c8-0c75-44b3-91b2-c71f91dc29b5),volume_type_id=9fe528c8-0c75-44b3-91b2-c71f91dc29b5)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47cc2d50-4d35-4372-9545-d1fea8da74f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47cc2d50-4d35-4372-9545-d1fea8da74f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44037cd4-9622-4b5e-9ea5-77ac4b650f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44037cd4-9622-4b5e-9ea5-77ac4b650f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67b9dcb5-b365-405a-8b73-a045bb08ed70', 'volume_name': 'volume-67b9dcb5-b365-405a-8b73-a045bb08ed70', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e303df6-9f3a-479c-9d18-c1758fac83f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e303df6-9f3a-479c-9d18-c1758fac83f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa5a433-3e15-45e1-b936-8386ca199c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:25 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] Volume 67b9dcb5-b365-405a-8b73-a045bb08ed70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67b9dcb5-b365-405a-8b73-a045bb08ed70', 'volume_size': 1} Sep 10 19:53:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:25 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=59410c77-60e8-43b4-9ff7-b4ced5c4d509,created_at=2026-09-10T17:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-806661118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=59410c77-60e8-43b4-9ff7-b4ced5c4d509,host='devstack@QuobyteHD#QuobyteHD',id=67b9dcb5-b365-405a-8b73-a045bb08ed70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34f7eb764b6412ca9322643a962b736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:53:25Z,use_quota=True,user_id='b0a76e90e32b41ebb48ccc7890510cce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fe528c8-0c75-44b3-91b2-c71f91dc29b5),volume_type_id=9fe528c8-0c75-44b3-91b2-c71f91dc29b5)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:53:25 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] Creating volume 67b9dcb5-b365-405a-8b73-a045bb08ed70 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:53:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:25 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:53:25 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e Sep 10 19:53:25 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:53:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:25 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:25 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:53:25 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:53:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-67b9dcb5-b365-405a-8b73-a045bb08ed70 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:25 devstack sudo[99855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-67b9dcb5-b365-405a-8b73-a045bb08ed70 1073741824 Sep 10 19:53:25 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:25 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0bcdc32b-a631-4ef8-bb75-780ae80ef1cf tempest-SnapshotDependencyTests-253338435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e" returned: 0 in 0.574s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0bcdc32b-a631-4ef8-bb75-780ae80ef1cf tempest-SnapshotDependencyTests-253338435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:25 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e Sep 10 19:53:25 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:25 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-67b9dcb5-b365-405a-8b73-a045bb08ed70 1073741824" returned: 0 in 0.580s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-67b9dcb5-b365-405a-8b73-a045bb08ed70 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:26 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-67b9dcb5-b365-405a-8b73-a045bb08ed70 Sep 10 19:53:26 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:26 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0bcdc32b-a631-4ef8-bb75-780ae80ef1cf tempest-SnapshotDependencyTests-253338435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8f4045be-b2dd-4fa7-8a1f-47020705438e" returned: 0 in 0.329s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:26 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0bcdc32b-a631-4ef8-bb75-780ae80ef1cf tempest-SnapshotDependencyTests-253338435 None] Lock "cinder-quobyte-8f4045be-b2dd-4fa7-8a1f-47020705438e" released by "delete_volume" :: held 1.087s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:53:26 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-0bcdc32b-a631-4ef8-bb75-780ae80ef1cf tempest-SnapshotDependencyTests-253338435 None] Created reservations ['fc587054-d13e-4e10-8a2b-c47e86e74493', '07298991-7558-4e4c-9791-7be4a5c09d7e', 'bf971380-1393-4b66-8dff-c52636c5da2d', '7f5f86ce-d640-47bb-9a7a-1312baad3f10'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:53:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0bcdc32b-a631-4ef8-bb75-780ae80ef1cf tempest-SnapshotDependencyTests-253338435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0bcdc32b-a631-4ef8-bb75-780ae80ef1cf tempest-SnapshotDependencyTests-253338435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:26 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0bcdc32b-a631-4ef8-bb75-780ae80ef1cf tempest-SnapshotDependencyTests-253338435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:53:26 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0bcdc32b-a631-4ef8-bb75-780ae80ef1cf tempest-SnapshotDependencyTests-253338435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:53:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0bcdc32b-a631-4ef8-bb75-780ae80ef1cf tempest-SnapshotDependencyTests-253338435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0bcdc32b-a631-4ef8-bb75-780ae80ef1cf tempest-SnapshotDependencyTests-253338435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:26 devstack sudo[99875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:53:26 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:26 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-67b9dcb5-b365-405a-8b73-a045bb08ed70" returned: 0 in 0.421s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:26 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:53:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:26 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa5a433-3e15-45e1-b936-8386ca199c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67b9dcb5-b365-405a-8b73-a045bb08ed70', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:26 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (792cbea1-3060-4ec9-8d8c-ff53fd059249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:26 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:26 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] Volume volume-67b9dcb5-b365-405a-8b73-a045bb08ed70 (67b9dcb5-b365-405a-8b73-a045bb08ed70): created successfully Sep 10 19:53:26 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (792cbea1-3060-4ec9-8d8c-ff53fd059249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:26 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] Flow 'volume_create_manager' (ed4edcae-a8c1-40f3-a39a-d132673062bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:53:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_wmx8fmg9devstack@QuobyteHD /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a28adc65-e365-46a9-8e24-c5ce969074bf" returned: 0 in 2.528s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:26 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_wmx8fmg9devstack@QuobyteHD, size 112.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a28adc65-e365-46a9-8e24-c5ce969074bf {{(pid=88093) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 19:53:26 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Converted 112.00 MB image at 44.27 MB/s Sep 10 19:53:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a28adc65-e365-46a9-8e24-c5ce969074bf 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:26 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-957dcf9f-9c46-4ce5-945e-65b813eef98e tempest-GroupsTest-766275528 None] Created volume successfully. Sep 10 19:53:26 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a28adc65-e365-46a9-8e24-c5ce969074bf 1G Sep 10 19:53:26 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:26 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0bcdc32b-a631-4ef8-bb75-780ae80ef1cf tempest-SnapshotDependencyTests-253338435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.348s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:26 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-0bcdc32b-a631-4ef8-bb75-780ae80ef1cf tempest-SnapshotDependencyTests-253338435 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:53:26 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-0bcdc32b-a631-4ef8-bb75-780ae80ef1cf tempest-SnapshotDependencyTests-253338435 None] Deleted volume successfully. Sep 10 19:53:26 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0bcdc32b-a631-4ef8-bb75-780ae80ef1cf tempest-SnapshotDependencyTests-253338435 None] Lock "cinder-8f4045be-b2dd-4fa7-8a1f-47020705438e-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:53:26 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a28adc65-e365-46a9-8e24-c5ce969074bf 1G" returned: 0 in 0.402s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:26 devstack cinder-volume[88093]: DEBUG cinder.volume.volume_utils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Downloaded image ce7b5bdf-521a-42b1-b62b-e8406ccf342b ((None, [{'url': 'file:///opt/stack/data/glance/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'metadata': {}}])) to volume a28adc65-e365-46a9-8e24-c5ce969074bf successfully. {{(pid=88093) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 19:53:26 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Temporary image ce7b5bdf-521a-42b1-b62b-e8406ccf342b for user ca3e7c312c7246e499e2d7b8a5628d09 is deleted. {{(pid=88093) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 19:53:26 devstack cinder-volume[88093]: DEBUG cinder.volume.volume_utils [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Marking volume a28adc65-e365-46a9-8e24-c5ce969074bf as bootable. {{(pid=88093) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 19:53:26 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Copying metadata from image ce7b5bdf-521a-42b1-b62b-e8406ccf342b to a28adc65-e365-46a9-8e24-c5ce969074bf. {{(pid=88093) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 19:53:26 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Creating volume glance metadata for volume a28adc65-e365-46a9-8e24-c5ce969074bf backed by image ce7b5bdf-521a-42b1-b62b-e8406ccf342b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88093) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 19:53:26 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (485e5e02-20d7-4c08-abeb-984e3173bded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a28adc65-e365-46a9-8e24-c5ce969074bf', 'volume_size': 1, 'image_id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cce253731714c6797a2e9bce91009cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'created_at': datetime.datetime(2026, 9, 10, 17, 35, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 35, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:26 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8772dee7-905c-4df2-9cd3-00ab7f58c95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:27 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Volume volume-a28adc65-e365-46a9-8e24-c5ce969074bf (a28adc65-e365-46a9-8e24-c5ce969074bf): created successfully Sep 10 19:53:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8772dee7-905c-4df2-9cd3-00ab7f58c95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Flow 'volume_create_manager' (5faf17aa-839d-4e1d-98df-236ecdcca3e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:53:27 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-d3f7f272-448d-4ba3-ae36-ec13c91c3882 tempest-VolumesExtendTest-1054100775 None] Created volume successfully. Sep 10 19:53:27 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d94368ad-09ed-42af-9ba2-daeb19fa24be tempest-SnapshotDependencyTests-253338435 None] Acquiring lock "cinder-527d1519-05ef-4a84-84e9-044d78822bc6-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:53:27 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d94368ad-09ed-42af-9ba2-daeb19fa24be tempest-SnapshotDependencyTests-253338435 None] Lock "cinder-527d1519-05ef-4a84-84e9-044d78822bc6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:53:27 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d94368ad-09ed-42af-9ba2-daeb19fa24be tempest-SnapshotDependencyTests-253338435 None] Acquiring lock "cinder-quobyte-527d1519-05ef-4a84-84e9-044d78822bc6" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:53:27 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d94368ad-09ed-42af-9ba2-daeb19fa24be tempest-SnapshotDependencyTests-253338435 None] Lock "cinder-quobyte-527d1519-05ef-4a84-84e9-044d78822bc6" acquired by "delete_volume" :: waited 0.016s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:53:27 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc54ae1-fb62-4c23-bef2-e9d50f102ed0]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:53:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d94368ad-09ed-42af-9ba2-daeb19fa24be tempest-SnapshotDependencyTests-253338435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-527d1519-05ef-4a84-84e9-044d78822bc6 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:27 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-527d1519-05ef-4a84-84e9-044d78822bc6 Sep 10 19:53:27 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:27 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d94368ad-09ed-42af-9ba2-daeb19fa24be tempest-SnapshotDependencyTests-253338435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-527d1519-05ef-4a84-84e9-044d78822bc6" returned: 0 in 0.450s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d94368ad-09ed-42af-9ba2-daeb19fa24be tempest-SnapshotDependencyTests-253338435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-527d1519-05ef-4a84-84e9-044d78822bc6 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:27 devstack sudo[99889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-527d1519-05ef-4a84-84e9-044d78822bc6 Sep 10 19:53:27 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2aa26318-09e0-4ec5-b0a3-70131d44aa1f tempest-VolumesExtendTest-1054100775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2aa26318-09e0-4ec5-b0a3-70131d44aa1f tempest-VolumesExtendTest-1054100775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:27 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6c8bff-1b72-44b1-b085-50de5a508dfc]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:53:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2aa26318-09e0-4ec5-b0a3-70131d44aa1f tempest-VolumesExtendTest-1054100775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a28adc65-e365-46a9-8e24-c5ce969074bf {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:28 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-0efce2ee-e111-4f3f-a013-e6bb3653a2e9 tempest-GroupsTest-766275528 None] Update group completed successfully. Sep 10 19:53:28 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d94368ad-09ed-42af-9ba2-daeb19fa24be tempest-SnapshotDependencyTests-253338435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-527d1519-05ef-4a84-84e9-044d78822bc6" returned: 0 in 0.370s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:28 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a28adc65-e365-46a9-8e24-c5ce969074bf Sep 10 19:53:28 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d94368ad-09ed-42af-9ba2-daeb19fa24be tempest-SnapshotDependencyTests-253338435 None] Lock "cinder-quobyte-527d1519-05ef-4a84-84e9-044d78822bc6" released by "delete_volume" :: held 0.870s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:53:28 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:28 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-d94368ad-09ed-42af-9ba2-daeb19fa24be tempest-SnapshotDependencyTests-253338435 None] Created reservations ['7dae3d1a-7f29-4777-b57a-cb86f9e82840', '2a3564f1-3735-4e0b-8713-f80779d12123', 'ff43cbb3-ab39-4ace-bd7c-eabbf13aeb8d', '5e25d362-e3ed-4a3f-b89c-c09bb87cff2b'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:53:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d94368ad-09ed-42af-9ba2-daeb19fa24be tempest-SnapshotDependencyTests-253338435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d94368ad-09ed-42af-9ba2-daeb19fa24be tempest-SnapshotDependencyTests-253338435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d94368ad-09ed-42af-9ba2-daeb19fa24be tempest-SnapshotDependencyTests-253338435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:53:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d94368ad-09ed-42af-9ba2-daeb19fa24be tempest-SnapshotDependencyTests-253338435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:53:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d94368ad-09ed-42af-9ba2-daeb19fa24be tempest-SnapshotDependencyTests-253338435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d94368ad-09ed-42af-9ba2-daeb19fa24be tempest-SnapshotDependencyTests-253338435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:28 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:53:28 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:28 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2aa26318-09e0-4ec5-b0a3-70131d44aa1f tempest-VolumesExtendTest-1054100775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a28adc65-e365-46a9-8e24-c5ce969074bf" returned: 0 in 0.628s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2aa26318-09e0-4ec5-b0a3-70131d44aa1f tempest-VolumesExtendTest-1054100775 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a28adc65-e365-46a9-8e24-c5ce969074bf 2G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:28 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d94368ad-09ed-42af-9ba2-daeb19fa24be tempest-SnapshotDependencyTests-253338435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.363s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:28 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-d94368ad-09ed-42af-9ba2-daeb19fa24be tempest-SnapshotDependencyTests-253338435 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:53:28 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-d94368ad-09ed-42af-9ba2-daeb19fa24be tempest-SnapshotDependencyTests-253338435 None] Deleted volume successfully. Sep 10 19:53:28 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d94368ad-09ed-42af-9ba2-daeb19fa24be tempest-SnapshotDependencyTests-253338435 None] Lock "cinder-527d1519-05ef-4a84-84e9-044d78822bc6-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:53:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2aa26318-09e0-4ec5-b0a3-70131d44aa1f tempest-VolumesExtendTest-1054100775 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a28adc65-e365-46a9-8e24-c5ce969074bf 2G" returned: 0 in 0.158s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2aa26318-09e0-4ec5-b0a3-70131d44aa1f tempest-VolumesExtendTest-1054100775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.843s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:28 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-2aa26318-09e0-4ec5-b0a3-70131d44aa1f tempest-VolumesExtendTest-1054100775 None] Extend volume completed successfully. Sep 10 19:53:29 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-395a64ab-a7dd-4177-ad6b-9c1372da1f67 tempest-VolumesExtendTest-1054100775 None] Acquiring lock "cinder-a28adc65-e365-46a9-8e24-c5ce969074bf-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:53:29 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-395a64ab-a7dd-4177-ad6b-9c1372da1f67 tempest-VolumesExtendTest-1054100775 None] Lock "cinder-a28adc65-e365-46a9-8e24-c5ce969074bf-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:53:29 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=131,cinder:UPDATE=144,cinder:INSERT=38,cinder:DELETE=14 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:53:29 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-395a64ab-a7dd-4177-ad6b-9c1372da1f67 tempest-VolumesExtendTest-1054100775 None] Acquiring lock "cinder-quobyte-a28adc65-e365-46a9-8e24-c5ce969074bf" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:53:29 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-395a64ab-a7dd-4177-ad6b-9c1372da1f67 tempest-VolumesExtendTest-1054100775 None] Lock "cinder-quobyte-a28adc65-e365-46a9-8e24-c5ce969074bf" acquired by "delete_volume" :: waited 0.023s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:53:29 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-5d752790-ba8f-441d-a3b1-f4b7fe8e9b55 tempest-GroupsTest-766275528 None] Update group completed successfully. Sep 10 19:53:29 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2277b2f-9b98-4b29-b209-7c909044448c]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:53:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-395a64ab-a7dd-4177-ad6b-9c1372da1f67 tempest-VolumesExtendTest-1054100775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a28adc65-e365-46a9-8e24-c5ce969074bf {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:29 devstack sudo[99923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a28adc65-e365-46a9-8e24-c5ce969074bf Sep 10 19:53:29 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:30 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-395a64ab-a7dd-4177-ad6b-9c1372da1f67 tempest-VolumesExtendTest-1054100775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a28adc65-e365-46a9-8e24-c5ce969074bf" returned: 0 in 0.441s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-395a64ab-a7dd-4177-ad6b-9c1372da1f67 tempest-VolumesExtendTest-1054100775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a28adc65-e365-46a9-8e24-c5ce969074bf {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:30 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a28adc65-e365-46a9-8e24-c5ce969074bf Sep 10 19:53:30 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:30 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-395a64ab-a7dd-4177-ad6b-9c1372da1f67 tempest-VolumesExtendTest-1054100775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-a28adc65-e365-46a9-8e24-c5ce969074bf" returned: 0 in 0.290s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:30 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-395a64ab-a7dd-4177-ad6b-9c1372da1f67 tempest-VolumesExtendTest-1054100775 None] Lock "cinder-quobyte-a28adc65-e365-46a9-8e24-c5ce969074bf" released by "delete_volume" :: held 0.780s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:53:30 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-395a64ab-a7dd-4177-ad6b-9c1372da1f67 tempest-VolumesExtendTest-1054100775 None] Created reservations ['3f84902a-8f6c-4292-bb00-1088598f08a9', '193cbc97-83e3-4ffd-b056-f1d65e9af72e', '5a789597-3d2b-48b6-877a-fc6c2a2d4050', 'd939dfcd-5aea-401f-96e4-9d1dfdcabba4'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:53:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-395a64ab-a7dd-4177-ad6b-9c1372da1f67 tempest-VolumesExtendTest-1054100775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-395a64ab-a7dd-4177-ad6b-9c1372da1f67 tempest-VolumesExtendTest-1054100775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:30 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-395a64ab-a7dd-4177-ad6b-9c1372da1f67 tempest-VolumesExtendTest-1054100775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:53:30 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-395a64ab-a7dd-4177-ad6b-9c1372da1f67 tempest-VolumesExtendTest-1054100775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:53:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-395a64ab-a7dd-4177-ad6b-9c1372da1f67 tempest-VolumesExtendTest-1054100775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-395a64ab-a7dd-4177-ad6b-9c1372da1f67 tempest-VolumesExtendTest-1054100775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:30 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:53:30 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:31 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-395a64ab-a7dd-4177-ad6b-9c1372da1f67 tempest-VolumesExtendTest-1054100775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.465s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:31 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-395a64ab-a7dd-4177-ad6b-9c1372da1f67 tempest-VolumesExtendTest-1054100775 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:53:31 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-395a64ab-a7dd-4177-ad6b-9c1372da1f67 tempest-VolumesExtendTest-1054100775 None] Deleted volume successfully. Sep 10 19:53:31 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-395a64ab-a7dd-4177-ad6b-9c1372da1f67 tempest-VolumesExtendTest-1054100775 None] Lock "cinder-a28adc65-e365-46a9-8e24-c5ce969074bf-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:53:31 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:53:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] Flow 'volume_create_manager' (a182543d-4179-45f3-b04c-5eee7b6493f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:53:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b16ea6-e276-4899-95df-5a04401c6516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b16ea6-e276-4899-95df-5a04401c6516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-274589569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=590ed5ad-db3d-446c-8232-91921f02c685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68b81a66a8b5462c81ff9f16c8ce643d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:53:31Z,use_quota=True,user_id='ca3e7c312c7246e499e2d7b8a5628d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b25ca1-2e6a-4925-96cc-d2e78c679c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b25ca1-2e6a-4925-96cc-d2e78c679c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f699afae-f8ab-41a1-96bd-0f6e21b49cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f699afae-f8ab-41a1-96bd-0f6e21b49cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '590ed5ad-db3d-446c-8232-91921f02c685', 'volume_name': 'volume-590ed5ad-db3d-446c-8232-91921f02c685', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fefe417-c04f-4d83-8004-e0c760fc6ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fefe417-c04f-4d83-8004-e0c760fc6ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24440d10-c28d-431b-9097-f8120a67c87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:31 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] Volume 590ed5ad-db3d-446c-8232-91921f02c685: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-590ed5ad-db3d-446c-8232-91921f02c685', 'volume_size': 1} Sep 10 19:53:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-274589569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=590ed5ad-db3d-446c-8232-91921f02c685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68b81a66a8b5462c81ff9f16c8ce643d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:53:31Z,use_quota=True,user_id='ca3e7c312c7246e499e2d7b8a5628d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:53:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] Creating volume 590ed5ad-db3d-446c-8232-91921f02c685 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:53:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:53:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:53:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:53:31 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:53:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:31 devstack sudo[99971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685 1073741824 Sep 10 19:53:31 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:31 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-68cf9978-3810-49eb-a05b-7154e69ae44d tempest-GroupsTest-766275528 None] Acquiring lock "cinder-quobyte-044f2b6c-4320-46b1-a0ef-459cb63e5540" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:53:31 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-68cf9978-3810-49eb-a05b-7154e69ae44d tempest-GroupsTest-766275528 None] Lock "cinder-quobyte-044f2b6c-4320-46b1-a0ef-459cb63e5540" acquired by "delete_volume" :: waited 0.026s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:53:31 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a06931-9ba7-4486-9859-dd8f7561da07]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:53:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-68cf9978-3810-49eb-a05b-7154e69ae44d tempest-GroupsTest-766275528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-044f2b6c-4320-46b1-a0ef-459cb63e5540 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:32 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-044f2b6c-4320-46b1-a0ef-459cb63e5540 Sep 10 19:53:32 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:32 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685 1073741824" returned: 0 in 0.736s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:32 devstack sudo[99982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685 Sep 10 19:53:32 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:32 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-68cf9978-3810-49eb-a05b-7154e69ae44d tempest-GroupsTest-766275528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-044f2b6c-4320-46b1-a0ef-459cb63e5540" returned: 0 in 0.566s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-68cf9978-3810-49eb-a05b-7154e69ae44d tempest-GroupsTest-766275528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-044f2b6c-4320-46b1-a0ef-459cb63e5540 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:32 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-044f2b6c-4320-46b1-a0ef-459cb63e5540 Sep 10 19:53:32 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:32 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685" returned: 0 in 0.327s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:32 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:53:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:32 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24440d10-c28d-431b-9097-f8120a67c87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-590ed5ad-db3d-446c-8232-91921f02c685', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:32 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f85b347a-1814-4826-852c-a7daffbe9f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:32 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] Volume volume-590ed5ad-db3d-446c-8232-91921f02c685 (590ed5ad-db3d-446c-8232-91921f02c685): created successfully Sep 10 19:53:32 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f85b347a-1814-4826-852c-a7daffbe9f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:32 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] Flow 'volume_create_manager' (a182543d-4179-45f3-b04c-5eee7b6493f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:53:32 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-e5e29c66-8ac7-4505-ae5b-6434a51c4b94 tempest-VolumesExtendTest-1054100775 None] Created volume successfully. Sep 10 19:53:32 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-68cf9978-3810-49eb-a05b-7154e69ae44d tempest-GroupsTest-766275528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-044f2b6c-4320-46b1-a0ef-459cb63e5540" returned: 0 in 0.468s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:32 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-68cf9978-3810-49eb-a05b-7154e69ae44d tempest-GroupsTest-766275528 None] Lock "cinder-quobyte-044f2b6c-4320-46b1-a0ef-459cb63e5540" released by "delete_volume" :: held 1.126s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:53:32 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-68cf9978-3810-49eb-a05b-7154e69ae44d tempest-GroupsTest-766275528 None] Acquiring lock "cinder-quobyte-67b9dcb5-b365-405a-8b73-a045bb08ed70" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:53:32 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-68cf9978-3810-49eb-a05b-7154e69ae44d tempest-GroupsTest-766275528 None] Lock "cinder-quobyte-67b9dcb5-b365-405a-8b73-a045bb08ed70" acquired by "delete_volume" :: waited 0.026s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:53:33 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5485a44-7cf8-451c-9456-e35773697534]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:53:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-68cf9978-3810-49eb-a05b-7154e69ae44d tempest-GroupsTest-766275528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-67b9dcb5-b365-405a-8b73-a045bb08ed70 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:33 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-67b9dcb5-b365-405a-8b73-a045bb08ed70 Sep 10 19:53:33 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:33 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-68cf9978-3810-49eb-a05b-7154e69ae44d tempest-GroupsTest-766275528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-67b9dcb5-b365-405a-8b73-a045bb08ed70" returned: 0 in 0.667s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-68cf9978-3810-49eb-a05b-7154e69ae44d tempest-GroupsTest-766275528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-67b9dcb5-b365-405a-8b73-a045bb08ed70 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:33 devstack sudo[100056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-67b9dcb5-b365-405a-8b73-a045bb08ed70 Sep 10 19:53:33 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:34 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-68cf9978-3810-49eb-a05b-7154e69ae44d tempest-GroupsTest-766275528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-67b9dcb5-b365-405a-8b73-a045bb08ed70" returned: 0 in 0.428s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:34 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-68cf9978-3810-49eb-a05b-7154e69ae44d tempest-GroupsTest-766275528 None] Lock "cinder-quobyte-67b9dcb5-b365-405a-8b73-a045bb08ed70" released by "delete_volume" :: held 1.221s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:53:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-77763062-1ac7-4f28-93ae-9401104e7f08 tempest-VolumesExtendTest-1054100775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-77763062-1ac7-4f28-93ae-9401104e7f08 tempest-VolumesExtendTest-1054100775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:34 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-77763062-1ac7-4f28-93ae-9401104e7f08 tempest-VolumesExtendTest-1054100775 None] Creating offline snapshot 5f30976a-ac33-48ea-89a5-4c62cb057b35 of volume 590ed5ad-db3d-446c-8232-91921f02c685 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 19:53:34 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-68cf9978-3810-49eb-a05b-7154e69ae44d tempest-GroupsTest-766275528 None] Created reservations ['de8b7a46-977b-4940-a699-9b936e148a10'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:53:34 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[895cbdad-fe2b-4fd4-948e-6bd6abe926cd]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:53:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-77763062-1ac7-4f28-93ae-9401104e7f08 tempest-VolumesExtendTest-1054100775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:34 devstack cinder-volume[88093]: WARNING cinder.quota [None req-68cf9978-3810-49eb-a05b-7154e69ae44d tempest-GroupsTest-766275528 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-642546299 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-642546299, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:53:34 devstack cinder-volume[88093]: WARNING cinder.quota [None req-68cf9978-3810-49eb-a05b-7154e69ae44d tempest-GroupsTest-766275528 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-642546299 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-642546299, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:53:34 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-68cf9978-3810-49eb-a05b-7154e69ae44d tempest-GroupsTest-766275528 None] Created reservations ['fce19143-0f93-41c0-b946-0eb5a56a9187', '9108333e-832b-4088-a90d-bc8548f86f63', 'e697de7d-6501-4d63-8f2e-78dbd384a87d', 'f2f580ed-7f02-4332-94e1-3e46b71bc039'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:53:34 devstack sudo[100063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685 Sep 10 19:53:34 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:34 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-68cf9978-3810-49eb-a05b-7154e69ae44d tempest-GroupsTest-766275528 None] Created reservations ['f29959d1-72f7-4ac9-8f68-e5304f296867', '938b94ad-b103-4477-a001-950844e5e437', '2f394ef3-212e-40a4-a4df-0d1505e04032', '0955afca-99a3-4724-8b82-2eab64baa08d'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:53:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-68cf9978-3810-49eb-a05b-7154e69ae44d tempest-GroupsTest-766275528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-68cf9978-3810-49eb-a05b-7154e69ae44d tempest-GroupsTest-766275528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:35 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-68cf9978-3810-49eb-a05b-7154e69ae44d tempest-GroupsTest-766275528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:53:35 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-68cf9978-3810-49eb-a05b-7154e69ae44d tempest-GroupsTest-766275528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:53:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-68cf9978-3810-49eb-a05b-7154e69ae44d tempest-GroupsTest-766275528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-68cf9978-3810-49eb-a05b-7154e69ae44d tempest-GroupsTest-766275528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:35 devstack sudo[100070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:53:35 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:35 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-77763062-1ac7-4f28-93ae-9401104e7f08 tempest-VolumesExtendTest-1054100775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685" returned: 0 in 0.798s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-77763062-1ac7-4f28-93ae-9401104e7f08 tempest-VolumesExtendTest-1054100775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685.5f30976a-ac33-48ea-89a5-4c62cb057b35 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:35 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685.5f30976a-ac33-48ea-89a5-4c62cb057b35 1G Sep 10 19:53:35 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:35 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-68cf9978-3810-49eb-a05b-7154e69ae44d tempest-GroupsTest-766275528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.528s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:35 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-68cf9978-3810-49eb-a05b-7154e69ae44d tempest-GroupsTest-766275528 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:53:35 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-68cf9978-3810-49eb-a05b-7154e69ae44d tempest-GroupsTest-766275528 None] Delete group completed successfully. Sep 10 19:53:36 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-77763062-1ac7-4f28-93ae-9401104e7f08 tempest-VolumesExtendTest-1054100775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685.5f30976a-ac33-48ea-89a5-4c62cb057b35 1G" returned: 0 in 0.868s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-77763062-1ac7-4f28-93ae-9401104e7f08 tempest-VolumesExtendTest-1054100775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-590ed5ad-db3d-446c-8232-91921f02c685 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685.5f30976a-ac33-48ea-89a5-4c62cb057b35 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:36 devstack sudo[100081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-590ed5ad-db3d-446c-8232-91921f02c685 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685.5f30976a-ac33-48ea-89a5-4c62cb057b35 Sep 10 19:53:36 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:36 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-77763062-1ac7-4f28-93ae-9401104e7f08 tempest-VolumesExtendTest-1054100775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-590ed5ad-db3d-446c-8232-91921f02c685 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685.5f30976a-ac33-48ea-89a5-4c62cb057b35" returned: 0 in 0.514s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:36 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-77763062-1ac7-4f28-93ae-9401104e7f08 tempest-VolumesExtendTest-1054100775 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685.5f30976a-ac33-48ea-89a5-4c62cb057b35 is being set with open permissions: ugo+rw Sep 10 19:53:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-77763062-1ac7-4f28-93ae-9401104e7f08 tempest-VolumesExtendTest-1054100775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685.5f30976a-ac33-48ea-89a5-4c62cb057b35 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:36 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685.5f30976a-ac33-48ea-89a5-4c62cb057b35 Sep 10 19:53:36 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-77763062-1ac7-4f28-93ae-9401104e7f08 tempest-VolumesExtendTest-1054100775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685.5f30976a-ac33-48ea-89a5-4c62cb057b35" returned: 0 in 0.451s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:37 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-77763062-1ac7-4f28-93ae-9401104e7f08 tempest-VolumesExtendTest-1054100775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:37 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685.info Sep 10 19:53:37 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2015b3b7-3de3-4c12-8425-85a2201ddce5 tempest-VolumesActionsTest-1568259041 None] Acquiring lock "cinder-5a940d3f-ef07-472a-8ba1-f59a1c076d43" by "attach_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:53:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2015b3b7-3de3-4c12-8425-85a2201ddce5 tempest-VolumesActionsTest-1568259041 None] Lock "cinder-5a940d3f-ef07-472a-8ba1-f59a1c076d43" acquired by "attach_volume" :: waited 0.055s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:53:37 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-2015b3b7-3de3-4c12-8425-85a2201ddce5 tempest-VolumesActionsTest-1568259041 None] Attaching volume 5a940d3f-ef07-472a-8ba1-f59a1c076d43 to instance 9bda796a-73f8-41a5-acef-b424ac0c650c at mountpoint /dev/vdb on host None. Sep 10 19:53:37 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:37 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-2015b3b7-3de3-4c12-8425-85a2201ddce5 tempest-VolumesActionsTest-1568259041 None] Attach volume completed successfully. Sep 10 19:53:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-77763062-1ac7-4f28-93ae-9401104e7f08 tempest-VolumesExtendTest-1054100775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685.info" returned: 0 in 0.580s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:37 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-77763062-1ac7-4f28-93ae-9401104e7f08 tempest-VolumesExtendTest-1054100775 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685.info is being set with open permissions: ugo+rw Sep 10 19:53:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-77763062-1ac7-4f28-93ae-9401104e7f08 tempest-VolumesExtendTest-1054100775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2015b3b7-3de3-4c12-8425-85a2201ddce5 tempest-VolumesActionsTest-1568259041 None] Lock "cinder-5a940d3f-ef07-472a-8ba1-f59a1c076d43" released by "attach_volume" :: held 0.291s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:53:37 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685.info Sep 10 19:53:37 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1b25ab25-37a6-43b3-8a02-616d6b0846ae tempest-VolumesActionsTest-1568259041 None] Acquiring lock "cinder-5a940d3f-ef07-472a-8ba1-f59a1c076d43-detach_volume" by "detach_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:53:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1b25ab25-37a6-43b3-8a02-616d6b0846ae tempest-VolumesActionsTest-1568259041 None] Lock "cinder-5a940d3f-ef07-472a-8ba1-f59a1c076d43-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:53:38 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-1b25ab25-37a6-43b3-8a02-616d6b0846ae tempest-VolumesActionsTest-1568259041 None] Detaching volume 5a940d3f-ef07-472a-8ba1-f59a1c076d43 from instance 9bda796a-73f8-41a5-acef-b424ac0c650c. Sep 10 19:53:38 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-1b25ab25-37a6-43b3-8a02-616d6b0846ae tempest-VolumesActionsTest-1568259041 None] Detach volume completed successfully. Sep 10 19:53:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1b25ab25-37a6-43b3-8a02-616d6b0846ae tempest-VolumesActionsTest-1568259041 None] Lock "cinder-5a940d3f-ef07-472a-8ba1-f59a1c076d43-detach_volume" released by "detach_volume" :: held 0.161s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:53:38 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-77763062-1ac7-4f28-93ae-9401104e7f08 tempest-VolumesExtendTest-1054100775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685.info" returned: 0 in 0.532s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-77763062-1ac7-4f28-93ae-9401104e7f08 tempest-VolumesExtendTest-1054100775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.934s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:38 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-77763062-1ac7-4f28-93ae-9401104e7f08 tempest-VolumesExtendTest-1054100775 None] Create snapshot completed successfully Sep 10 19:53:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-aca33510-a40c-4165-b8ee-c4d02728c0d3 tempest-VolumesExtendTest-1054100775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-aca33510-a40c-4165-b8ee-c4d02728c0d3 tempest-VolumesExtendTest-1054100775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:38 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac61087-a58e-4910-beb9-02bd93d8f5f1]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:53:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-aca33510-a40c-4165-b8ee-c4d02728c0d3 tempest-VolumesExtendTest-1054100775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:39 devstack sudo[100102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685 Sep 10 19:53:39 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:39 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-aca33510-a40c-4165-b8ee-c4d02728c0d3 tempest-VolumesExtendTest-1054100775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685" returned: 0 in 0.679s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-aca33510-a40c-4165-b8ee-c4d02728c0d3 tempest-VolumesExtendTest-1054100775 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685.5f30976a-ac33-48ea-89a5-4c62cb057b35 2G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-aca33510-a40c-4165-b8ee-c4d02728c0d3 tempest-VolumesExtendTest-1054100775 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685.5f30976a-ac33-48ea-89a5-4c62cb057b35 2G" returned: 0 in 0.224s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-aca33510-a40c-4165-b8ee-c4d02728c0d3 tempest-VolumesExtendTest-1054100775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.984s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:39 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-aca33510-a40c-4165-b8ee-c4d02728c0d3 tempest-VolumesExtendTest-1054100775 None] Extend volume completed successfully. Sep 10 19:53:40 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-47b65192-e255-4d13-b348-32cf4e09d8d1 tempest-VolumesExtendTest-1054100775 None] Acquiring lock "cinder-5f30976a-ac33-48ea-89a5-4c62cb057b35-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:53:40 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-47b65192-e255-4d13-b348-32cf4e09d8d1 tempest-VolumesExtendTest-1054100775 None] Lock "cinder-5f30976a-ac33-48ea-89a5-4c62cb057b35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:53:40 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-47b65192-e255-4d13-b348-32cf4e09d8d1 tempest-VolumesExtendTest-1054100775 None] Acquiring lock "cinder-quobyte-590ed5ad-db3d-446c-8232-91921f02c685" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:53:40 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-47b65192-e255-4d13-b348-32cf4e09d8d1 tempest-VolumesExtendTest-1054100775 None] Lock "cinder-quobyte-590ed5ad-db3d-446c-8232-91921f02c685" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:53:40 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-47b65192-e255-4d13-b348-32cf4e09d8d1 tempest-VolumesExtendTest-1054100775 None] Acquiring lock "cinder-quobyte-5f30976a-ac33-48ea-89a5-4c62cb057b35" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:53:40 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-47b65192-e255-4d13-b348-32cf4e09d8d1 tempest-VolumesExtendTest-1054100775 None] Lock "cinder-quobyte-5f30976a-ac33-48ea-89a5-4c62cb057b35" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:53:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-47b65192-e255-4d13-b348-32cf4e09d8d1 tempest-VolumesExtendTest-1054100775 None] Deleting offline snapshot 5f30976a-ac33-48ea-89a5-4c62cb057b35 of volume 590ed5ad-db3d-446c-8232-91921f02c685 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 19:53:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-47b65192-e255-4d13-b348-32cf4e09d8d1 tempest-VolumesExtendTest-1054100775 None] snapshot_file for this snap is: volume-590ed5ad-db3d-446c-8232-91921f02c685.5f30976a-ac33-48ea-89a5-4c62cb057b35 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 19:53:40 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1e5f2c-e8ce-4995-b3a9-2bb70a94055f]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:53:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-47b65192-e255-4d13-b348-32cf4e09d8d1 tempest-VolumesExtendTest-1054100775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685.5f30976a-ac33-48ea-89a5-4c62cb057b35 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:40 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685.5f30976a-ac33-48ea-89a5-4c62cb057b35 Sep 10 19:53:40 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:41 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-47b65192-e255-4d13-b348-32cf4e09d8d1 tempest-VolumesExtendTest-1054100775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685.5f30976a-ac33-48ea-89a5-4c62cb057b35" returned: 0 in 0.659s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-47b65192-e255-4d13-b348-32cf4e09d8d1 tempest-VolumesExtendTest-1054100775 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-590ed5ad-db3d-446c-8232-91921f02c685(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:53:41 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a30fff-eccc-442b-aed5-2fa5b2e649de]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:53:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-47b65192-e255-4d13-b348-32cf4e09d8d1 tempest-VolumesExtendTest-1054100775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:41 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685 Sep 10 19:53:41 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:41 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-47b65192-e255-4d13-b348-32cf4e09d8d1 tempest-VolumesExtendTest-1054100775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685" returned: 0 in 0.426s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-47b65192-e255-4d13-b348-32cf4e09d8d1 tempest-VolumesExtendTest-1054100775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685.5f30976a-ac33-48ea-89a5-4c62cb057b35 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:41 devstack sudo[100141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685.5f30976a-ac33-48ea-89a5-4c62cb057b35 Sep 10 19:53:41 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:42 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-47b65192-e255-4d13-b348-32cf4e09d8d1 tempest-VolumesExtendTest-1054100775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685.5f30976a-ac33-48ea-89a5-4c62cb057b35" returned: 0 in 0.438s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-47b65192-e255-4d13-b348-32cf4e09d8d1 tempest-VolumesExtendTest-1054100775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685.5f30976a-ac33-48ea-89a5-4c62cb057b35 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:42 devstack sudo[100147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685.5f30976a-ac33-48ea-89a5-4c62cb057b35 Sep 10 19:53:42 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:42 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-47b65192-e255-4d13-b348-32cf4e09d8d1 tempest-VolumesExtendTest-1054100775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685.5f30976a-ac33-48ea-89a5-4c62cb057b35" returned: 0 in 0.297s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:42 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-47b65192-e255-4d13-b348-32cf4e09d8d1 tempest-VolumesExtendTest-1054100775 None] Lock "cinder-quobyte-5f30976a-ac33-48ea-89a5-4c62cb057b35" released by "_delete_snapshot" :: held 2.077s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:53:42 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-47b65192-e255-4d13-b348-32cf4e09d8d1 tempest-VolumesExtendTest-1054100775 None] Lock "cinder-quobyte-590ed5ad-db3d-446c-8232-91921f02c685" released by "delete_snapshot" :: held 2.116s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:53:42 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-47b65192-e255-4d13-b348-32cf4e09d8d1 tempest-VolumesExtendTest-1054100775 None] Created reservations ['2ecc25f3-3ec8-412b-899e-07e9b0ad4f29', '168d5fbf-0912-43a5-8108-8f17ba591dce', '151952be-bb90-43f8-8f2d-892348ab345a', 'd12c52a2-4de1-4913-b2c9-77da875eedb3'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:53:42 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-47b65192-e255-4d13-b348-32cf4e09d8d1 tempest-VolumesExtendTest-1054100775 None] Delete snapshot completed successfully. Sep 10 19:53:42 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-47b65192-e255-4d13-b348-32cf4e09d8d1 tempest-VolumesExtendTest-1054100775 None] Lock "cinder-5f30976a-ac33-48ea-89a5-4c62cb057b35-delete_snapshot" released by "delete_snapshot" :: held 2.344s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:53:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cb56da0e-ab94-4645-a8f6-e17885d3cd0c tempest-VolumesExtendTest-1054100775 None] Acquiring lock "cinder-590ed5ad-db3d-446c-8232-91921f02c685-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:53:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cb56da0e-ab94-4645-a8f6-e17885d3cd0c tempest-VolumesExtendTest-1054100775 None] Lock "cinder-590ed5ad-db3d-446c-8232-91921f02c685-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:53:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cb56da0e-ab94-4645-a8f6-e17885d3cd0c tempest-VolumesExtendTest-1054100775 None] Acquiring lock "cinder-quobyte-590ed5ad-db3d-446c-8232-91921f02c685" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:53:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cb56da0e-ab94-4645-a8f6-e17885d3cd0c tempest-VolumesExtendTest-1054100775 None] Lock "cinder-quobyte-590ed5ad-db3d-446c-8232-91921f02c685" acquired by "delete_volume" :: waited 0.033s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:53:44 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[5267f0ef-385d-4f57-9088-a989ac715d6f]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:53:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cb56da0e-ab94-4645-a8f6-e17885d3cd0c tempest-VolumesExtendTest-1054100775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:44 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685 Sep 10 19:53:44 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:44 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cb56da0e-ab94-4645-a8f6-e17885d3cd0c tempest-VolumesExtendTest-1054100775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685" returned: 0 in 0.594s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cb56da0e-ab94-4645-a8f6-e17885d3cd0c tempest-VolumesExtendTest-1054100775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:44 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685 Sep 10 19:53:44 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:45 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cb56da0e-ab94-4645-a8f6-e17885d3cd0c tempest-VolumesExtendTest-1054100775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-590ed5ad-db3d-446c-8232-91921f02c685" returned: 0 in 0.401s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:45 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cb56da0e-ab94-4645-a8f6-e17885d3cd0c tempest-VolumesExtendTest-1054100775 None] Lock "cinder-quobyte-590ed5ad-db3d-446c-8232-91921f02c685" released by "delete_volume" :: held 1.111s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:53:45 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-cb56da0e-ab94-4645-a8f6-e17885d3cd0c tempest-VolumesExtendTest-1054100775 None] Created reservations ['40d13924-3821-43f3-9b75-193bab2335f3', '66ca75a4-1b69-4ffb-8237-725d02e8fa26', '6aba0014-bfc5-42c5-87c0-69f73364d2b6', 'd90905fc-ef60-4e2a-bf30-4352c9fdb167'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:53:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cb56da0e-ab94-4645-a8f6-e17885d3cd0c tempest-VolumesExtendTest-1054100775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cb56da0e-ab94-4645-a8f6-e17885d3cd0c tempest-VolumesExtendTest-1054100775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-cb56da0e-ab94-4645-a8f6-e17885d3cd0c tempest-VolumesExtendTest-1054100775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:53:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-cb56da0e-ab94-4645-a8f6-e17885d3cd0c tempest-VolumesExtendTest-1054100775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:53:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cb56da0e-ab94-4645-a8f6-e17885d3cd0c tempest-VolumesExtendTest-1054100775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cb56da0e-ab94-4645-a8f6-e17885d3cd0c tempest-VolumesExtendTest-1054100775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:45 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:53:45 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:45 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cb56da0e-ab94-4645-a8f6-e17885d3cd0c tempest-VolumesExtendTest-1054100775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.437s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:45 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-cb56da0e-ab94-4645-a8f6-e17885d3cd0c tempest-VolumesExtendTest-1054100775 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:53:45 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-cb56da0e-ab94-4645-a8f6-e17885d3cd0c tempest-VolumesExtendTest-1054100775 None] Deleted volume successfully. Sep 10 19:53:45 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cb56da0e-ab94-4645-a8f6-e17885d3cd0c tempest-VolumesExtendTest-1054100775 None] Lock "cinder-590ed5ad-db3d-446c-8232-91921f02c685-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:53:47 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-27e80173-79e3-4c6d-bb27-a8f1b477067f tempest-GroupsV320Test-1501286478 None] Group tempest-GroupsV320Test-Group-1454566977: creating Sep 10 19:53:47 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-27e80173-79e3-4c6d-bb27-a8f1b477067f tempest-GroupsV320Test-1501286478 None] Group tempest-GroupsV320Test-Group-1454566977: created successfully Sep 10 19:53:47 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-27e80173-79e3-4c6d-bb27-a8f1b477067f tempest-GroupsV320Test-1501286478 None] Create group completed successfully. Sep 10 19:53:49 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-cefce81f-c903-401f-bb34-99febed84bcc tempest-GroupsV320Test-1501286478 None] Created reservations ['66079afd-ccba-4979-869d-c29f7567db0b'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:53:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cefce81f-c903-401f-bb34-99febed84bcc tempest-GroupsV320Test-1501286478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cefce81f-c903-401f-bb34-99febed84bcc tempest-GroupsV320Test-1501286478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-cefce81f-c903-401f-bb34-99febed84bcc tempest-GroupsV320Test-1501286478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:53:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-cefce81f-c903-401f-bb34-99febed84bcc tempest-GroupsV320Test-1501286478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:53:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cefce81f-c903-401f-bb34-99febed84bcc tempest-GroupsV320Test-1501286478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cefce81f-c903-401f-bb34-99febed84bcc tempest-GroupsV320Test-1501286478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:49 devstack sudo[100189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:53:49 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:49 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cefce81f-c903-401f-bb34-99febed84bcc tempest-GroupsV320Test-1501286478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.300s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:49 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-cefce81f-c903-401f-bb34-99febed84bcc tempest-GroupsV320Test-1501286478 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:53:49 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-cefce81f-c903-401f-bb34-99febed84bcc tempest-GroupsV320Test-1501286478 None] Delete group completed successfully. Sep 10 19:53:52 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:53:52 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] Flow 'volume_create_manager' (928a2249-9a1d-440d-83d5-3db29d6f4b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:53:52 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd33bb8d-8f8c-4b5c-9e98-7eae5f523323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:52 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd33bb8d-8f8c-4b5c-9e98-7eae5f523323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1037964636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a03b99-4bbb-4af7-aa4f-690731e8a127,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='68c39f3c07c94daf9bd50b0b6cbdb78b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:53:53Z,use_quota=True,user_id='1d61e9c0d15b4d7896d2ad1b9c988e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:52 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93bd1f43-e631-4b25-89e5-88e107b009c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:52 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93bd1f43-e631-4b25-89e5-88e107b009c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:52 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683ef37b-1afc-4033-a419-35a444232448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:52 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683ef37b-1afc-4033-a419-35a444232448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51a03b99-4bbb-4af7-aa4f-690731e8a127', 'volume_name': 'volume-51a03b99-4bbb-4af7-aa4f-690731e8a127', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:52 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5086c985-b96b-449a-ac05-d08ded762ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:52 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5086c985-b96b-449a-ac05-d08ded762ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:52 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227458ab-0444-43ac-a2d5-22bf35d7c7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:52 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] Volume 51a03b99-4bbb-4af7-aa4f-690731e8a127: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51a03b99-4bbb-4af7-aa4f-690731e8a127', 'volume_size': 1} Sep 10 19:53:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:52 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1037964636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a03b99-4bbb-4af7-aa4f-690731e8a127,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='68c39f3c07c94daf9bd50b0b6cbdb78b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:53:53Z,use_quota=True,user_id='1d61e9c0d15b4d7896d2ad1b9c988e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:53:52 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] Creating volume 51a03b99-4bbb-4af7-aa4f-690731e8a127 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:53:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:52 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:53:52 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:53:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:52 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:53:52 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:53:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51a03b99-4bbb-4af7-aa4f-690731e8a127 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:52 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51a03b99-4bbb-4af7-aa4f-690731e8a127 1073741824 Sep 10 19:53:52 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:53 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51a03b99-4bbb-4af7-aa4f-690731e8a127 1073741824" returned: 0 in 0.679s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51a03b99-4bbb-4af7-aa4f-690731e8a127 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5c49b589-a078-4f35-b174-2a491c6fab39 tempest-VolumesActionsTest-1568259041 None] Acquiring lock "cinder-5a940d3f-ef07-472a-8ba1-f59a1c076d43" by "attach_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:53:53 devstack sudo[100269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51a03b99-4bbb-4af7-aa4f-690731e8a127 Sep 10 19:53:53 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5c49b589-a078-4f35-b174-2a491c6fab39 tempest-VolumesActionsTest-1568259041 None] Lock "cinder-5a940d3f-ef07-472a-8ba1-f59a1c076d43" acquired by "attach_volume" :: waited 0.034s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:53:53 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-5c49b589-a078-4f35-b174-2a491c6fab39 tempest-VolumesActionsTest-1568259041 None] Attaching volume 5a940d3f-ef07-472a-8ba1-f59a1c076d43 to instance add87ad0-5035-494f-8b21-195349b84743 at mountpoint /dev/vdb on host None. Sep 10 19:53:53 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-5c49b589-a078-4f35-b174-2a491c6fab39 tempest-VolumesActionsTest-1568259041 None] Attach volume completed successfully. Sep 10 19:53:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5c49b589-a078-4f35-b174-2a491c6fab39 tempest-VolumesActionsTest-1568259041 None] Lock "cinder-5a940d3f-ef07-472a-8ba1-f59a1c076d43" released by "attach_volume" :: held 0.243s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:53:54 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51a03b99-4bbb-4af7-aa4f-690731e8a127" returned: 0 in 0.477s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:54 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:53:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227458ab-0444-43ac-a2d5-22bf35d7c7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51a03b99-4bbb-4af7-aa4f-690731e8a127', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d632e3-6faa-41f9-a989-c6d2d6561822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:54 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] Volume volume-51a03b99-4bbb-4af7-aa4f-690731e8a127 (51a03b99-4bbb-4af7-aa4f-690731e8a127): created successfully Sep 10 19:53:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d632e3-6faa-41f9-a989-c6d2d6561822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] Flow 'volume_create_manager' (928a2249-9a1d-440d-83d5-3db29d6f4b0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:53:54 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-e89c6044-d845-43c2-a1ef-51c6357b85e5 tempest-VolumesGetTest-150381411 None] Created volume successfully. Sep 10 19:53:54 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e61a3fbd-c9dc-4564-a233-44eec2225276 tempest-VolumesActionsTest-1568259041 None] Acquiring lock "cinder-5a940d3f-ef07-472a-8ba1-f59a1c076d43-detach_volume" by "detach_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:53:54 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e61a3fbd-c9dc-4564-a233-44eec2225276 tempest-VolumesActionsTest-1568259041 None] Lock "cinder-5a940d3f-ef07-472a-8ba1-f59a1c076d43-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:53:54 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-e61a3fbd-c9dc-4564-a233-44eec2225276 tempest-VolumesActionsTest-1568259041 None] Detaching volume 5a940d3f-ef07-472a-8ba1-f59a1c076d43 from instance add87ad0-5035-494f-8b21-195349b84743. Sep 10 19:53:54 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-e61a3fbd-c9dc-4564-a233-44eec2225276 tempest-VolumesActionsTest-1568259041 None] Detach volume completed successfully. Sep 10 19:53:54 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e61a3fbd-c9dc-4564-a233-44eec2225276 tempest-VolumesActionsTest-1568259041 None] Lock "cinder-5a940d3f-ef07-472a-8ba1-f59a1c076d43-detach_volume" released by "detach_volume" :: held 0.088s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:53:56 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:53:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] Flow 'volume_create_manager' (5c762bcc-d6c0-4c59-83e8-7f387234015d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:53:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506fd733-2e82-4757-a976-06e55f7ab8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506fd733-2e82-4757-a976-06e55f7ab8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:53:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1922887330',display_name='tempest-VolumesGetTest-Volume-907950643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdb71931-0013-432e-bc99-eac188f36051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c39f3c07c94daf9bd50b0b6cbdb78b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:53:56Z,use_quota=True,user_id='1d61e9c0d15b4d7896d2ad1b9c988e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10568b1a-fab9-491b-afc0-3616a1563e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10568b1a-fab9-491b-afc0-3616a1563e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddbbe8b0-a121-4253-9119-b50e2c09172b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddbbe8b0-a121-4253-9119-b50e2c09172b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdb71931-0013-432e-bc99-eac188f36051', 'volume_name': 'volume-cdb71931-0013-432e-bc99-eac188f36051', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c4600d-9a5e-4e0b-943c-31dddcb2b593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c4600d-9a5e-4e0b-943c-31dddcb2b593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a22cf1-459d-40d9-9edd-6437a47a634e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:56 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] Volume cdb71931-0013-432e-bc99-eac188f36051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdb71931-0013-432e-bc99-eac188f36051', 'volume_size': 1} Sep 10 19:53:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:53:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1922887330',display_name='tempest-VolumesGetTest-Volume-907950643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdb71931-0013-432e-bc99-eac188f36051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c39f3c07c94daf9bd50b0b6cbdb78b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:53:56Z,use_quota=True,user_id='1d61e9c0d15b4d7896d2ad1b9c988e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:53:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] Creating volume cdb71931-0013-432e-bc99-eac188f36051 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:53:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:53:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:53:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:53:56 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:53:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-cdb71931-0013-432e-bc99-eac188f36051 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:56 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-cdb71931-0013-432e-bc99-eac188f36051 1073741824 Sep 10 19:53:56 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:57 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-cdb71931-0013-432e-bc99-eac188f36051 1073741824" returned: 0 in 0.711s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-cdb71931-0013-432e-bc99-eac188f36051 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:57 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-cdb71931-0013-432e-bc99-eac188f36051 Sep 10 19:53:57 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:57 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-cdb71931-0013-432e-bc99-eac188f36051" returned: 0 in 0.301s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:57 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:53:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a22cf1-459d-40d9-9edd-6437a47a634e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdb71931-0013-432e-bc99-eac188f36051', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ad460b-a3de-411f-934a-7fdf483b9560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:57 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] Volume volume-cdb71931-0013-432e-bc99-eac188f36051 (cdb71931-0013-432e-bc99-eac188f36051): created successfully Sep 10 19:53:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ad460b-a3de-411f-934a-7fdf483b9560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] Flow 'volume_create_manager' (5c762bcc-d6c0-4c59-83e8-7f387234015d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:53:57 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-5037c7f3-37ab-4b79-8eb7-92e9047a89a8 tempest-VolumesGetTest-150381411 None] Created volume successfully. Sep 10 19:53:58 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-649d7613-50ff-45c3-bccd-176e9b6b0718 tempest-VolumesGetTest-150381411 None] Acquiring lock "cinder-cdb71931-0013-432e-bc99-eac188f36051-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:53:58 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-649d7613-50ff-45c3-bccd-176e9b6b0718 tempest-VolumesGetTest-150381411 None] Lock "cinder-cdb71931-0013-432e-bc99-eac188f36051-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:53:58 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-649d7613-50ff-45c3-bccd-176e9b6b0718 tempest-VolumesGetTest-150381411 None] Acquiring lock "cinder-quobyte-cdb71931-0013-432e-bc99-eac188f36051" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:53:58 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-649d7613-50ff-45c3-bccd-176e9b6b0718 tempest-VolumesGetTest-150381411 None] Lock "cinder-quobyte-cdb71931-0013-432e-bc99-eac188f36051" acquired by "delete_volume" :: waited 0.015s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:53:58 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e5a4c6-4562-45f0-b778-2e5ff334ba76]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:53:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-649d7613-50ff-45c3-bccd-176e9b6b0718 tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-cdb71931-0013-432e-bc99-eac188f36051 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:59 devstack sudo[100305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-cdb71931-0013-432e-bc99-eac188f36051 Sep 10 19:53:59 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:59 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-649d7613-50ff-45c3-bccd-176e9b6b0718 tempest-VolumesGetTest-150381411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-cdb71931-0013-432e-bc99-eac188f36051" returned: 0 in 0.450s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-649d7613-50ff-45c3-bccd-176e9b6b0718 tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-cdb71931-0013-432e-bc99-eac188f36051 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:59 devstack sudo[100310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-cdb71931-0013-432e-bc99-eac188f36051 Sep 10 19:53:59 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:59 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-649d7613-50ff-45c3-bccd-176e9b6b0718 tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-cdb71931-0013-432e-bc99-eac188f36051" returned: 0 in 0.313s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] Flow 'volume_create_manager' (55c67033-c363-458d-9163-3e739b160182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd401c9f-e6f4-4a9b-92a8-dffac0b6523f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-649d7613-50ff-45c3-bccd-176e9b6b0718 tempest-VolumesGetTest-150381411 None] Lock "cinder-quobyte-cdb71931-0013-432e-bc99-eac188f36051" released by "delete_volume" :: held 0.845s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd401c9f-e6f4-4a9b-92a8-dffac0b6523f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-810511000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6688cd76-af2a-4524-95ef-fdc2a62867a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f88c1fb6ca7403da3bac3f8cac662e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:54:00Z,use_quota=True,user_id='05524eb4f37748e4bdf51d3f8a4bfcc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731aa3fd-535a-43a5-bc69-7c287daa0928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731aa3fd-535a-43a5-bc69-7c287daa0928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1357a10-2a0f-4f70-b9f2-e2a675ee0bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1357a10-2a0f-4f70-b9f2-e2a675ee0bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6688cd76-af2a-4524-95ef-fdc2a62867a9', 'volume_name': 'volume-6688cd76-af2a-4524-95ef-fdc2a62867a9', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c29ee00b-f9b2-4629-88f9-4225aa0aee63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c29ee00b-f9b2-4629-88f9-4225aa0aee63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9baf6757-32c8-421a-9cab-3ca3e3924569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:53:59 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] Volume 6688cd76-af2a-4524-95ef-fdc2a62867a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6688cd76-af2a-4524-95ef-fdc2a62867a9', 'volume_size': 1} Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-810511000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6688cd76-af2a-4524-95ef-fdc2a62867a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f88c1fb6ca7403da3bac3f8cac662e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:54:00Z,use_quota=True,user_id='05524eb4f37748e4bdf51d3f8a4bfcc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] Creating volume 6688cd76-af2a-4524-95ef-fdc2a62867a9 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:53:59 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:59 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9 1073741824 Sep 10 19:53:59 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-649d7613-50ff-45c3-bccd-176e9b6b0718 tempest-VolumesGetTest-150381411 None] Created reservations ['3acfa728-d211-47d9-8ae9-fad1dc3ce296', '2b22e2bc-ceb7-47e0-8db1-074afaa8a929', '083d4b14-bae2-46ef-9b01-9fbfccb84656', '9b072a57-b894-4e8b-805d-0e3317c1f6c8'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-649d7613-50ff-45c3-bccd-176e9b6b0718 tempest-VolumesGetTest-150381411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-649d7613-50ff-45c3-bccd-176e9b6b0718 tempest-VolumesGetTest-150381411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-649d7613-50ff-45c3-bccd-176e9b6b0718 tempest-VolumesGetTest-150381411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-649d7613-50ff-45c3-bccd-176e9b6b0718 tempest-VolumesGetTest-150381411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-649d7613-50ff-45c3-bccd-176e9b6b0718 tempest-VolumesGetTest-150381411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:53:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-649d7613-50ff-45c3-bccd-176e9b6b0718 tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:53:59 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:53:59 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5370452f-9b7e-445a-8573-942654dd3d47 tempest-VolumesActionsTest-1568259041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:54:00 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-649d7613-50ff-45c3-bccd-176e9b6b0718 tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.279s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:00 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-649d7613-50ff-45c3-bccd-176e9b6b0718 tempest-VolumesGetTest-150381411 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:54:00 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-649d7613-50ff-45c3-bccd-176e9b6b0718 tempest-VolumesGetTest-150381411 None] Deleted volume successfully. Sep 10 19:54:00 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-649d7613-50ff-45c3-bccd-176e9b6b0718 tempest-VolumesGetTest-150381411 None] Lock "cinder-cdb71931-0013-432e-bc99-eac188f36051-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:54:00 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9 1073741824" returned: 0 in 0.491s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:00 devstack sudo[100323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9 Sep 10 19:54:00 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:00 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9" returned: 0 in 0.231s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:00 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:54:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:54:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5370452f-9b7e-445a-8573-942654dd3d47 tempest-VolumesActionsTest-1568259041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.455s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:54:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9baf6757-32c8-421a-9cab-3ca3e3924569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6688cd76-af2a-4524-95ef-fdc2a62867a9', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a16673-159c-4b23-9d40-64b4ffc6d473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:00 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[74125dc4-b3d6-45e1-a823-072458c4db41]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:54:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5370452f-9b7e-445a-8573-942654dd3d47 tempest-VolumesActionsTest-1568259041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:00 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] Volume volume-6688cd76-af2a-4524-95ef-fdc2a62867a9 (6688cd76-af2a-4524-95ef-fdc2a62867a9): created successfully Sep 10 19:54:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a16673-159c-4b23-9d40-64b4ffc6d473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] Flow 'volume_create_manager' (55c67033-c363-458d-9163-3e739b160182) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:54:00 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-d6c26934-e2e4-44ac-8c3f-fd4dc2fe6650 tempest-SnapshotsActionsTest-774626312 None] Created volume successfully. Sep 10 19:54:00 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43 Sep 10 19:54:00 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:00 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0a2236cb-9813-4ada-a39b-3e4f27d1e53f tempest-VolumesGetTest-150381411 None] Acquiring lock "cinder-51a03b99-4bbb-4af7-aa4f-690731e8a127-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:54:00 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0a2236cb-9813-4ada-a39b-3e4f27d1e53f tempest-VolumesGetTest-150381411 None] Lock "cinder-51a03b99-4bbb-4af7-aa4f-690731e8a127-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:54:00 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0a2236cb-9813-4ada-a39b-3e4f27d1e53f tempest-VolumesGetTest-150381411 None] Acquiring lock "cinder-quobyte-51a03b99-4bbb-4af7-aa4f-690731e8a127" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:54:00 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0a2236cb-9813-4ada-a39b-3e4f27d1e53f tempest-VolumesGetTest-150381411 None] Lock "cinder-quobyte-51a03b99-4bbb-4af7-aa4f-690731e8a127" acquired by "delete_volume" :: waited 0.031s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:54:00 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ee3899-21d7-4ea1-b815-4da74ec7ce41]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:54:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0a2236cb-9813-4ada-a39b-3e4f27d1e53f tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51a03b99-4bbb-4af7-aa4f-690731e8a127 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ec8c377c-809b-4b12-9df7-c44035d70bcd tempest-SnapshotsActionsTest-774626312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:54:01 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5370452f-9b7e-445a-8573-942654dd3d47 tempest-VolumesActionsTest-1568259041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43" returned: 0 in 0.450s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:01 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78ccdfb-cec7-4796-a3f5-40c7eb7319ad]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:54:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5370452f-9b7e-445a-8573-942654dd3d47 tempest-VolumesActionsTest-1568259041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:01 devstack sudo[100331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51a03b99-4bbb-4af7-aa4f-690731e8a127 Sep 10 19:54:01 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:01 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43 Sep 10 19:54:01 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:01 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0a2236cb-9813-4ada-a39b-3e4f27d1e53f tempest-VolumesGetTest-150381411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51a03b99-4bbb-4af7-aa4f-690731e8a127" returned: 0 in 0.397s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0a2236cb-9813-4ada-a39b-3e4f27d1e53f tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51a03b99-4bbb-4af7-aa4f-690731e8a127 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:01 devstack sudo[100340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51a03b99-4bbb-4af7-aa4f-690731e8a127 Sep 10 19:54:01 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:01 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5370452f-9b7e-445a-8573-942654dd3d47 tempest-VolumesActionsTest-1568259041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43" returned: 0 in 0.414s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5370452f-9b7e-445a-8573-942654dd3d47 tempest-VolumesActionsTest-1568259041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43 /opt/stack/data/cinder/conversion/5a940d3f-ef07-472a-8ba1-f59a1c076d43.temp_image.f07307aa-5105-4492-99ad-a9ee2b8c0fe5wg6pxvm0.img {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:01 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43 /opt/stack/data/cinder/conversion/5a940d3f-ef07-472a-8ba1-f59a1c076d43.temp_image.f07307aa-5105-4492-99ad-a9ee2b8c0fe5wg6pxvm0.img Sep 10 19:54:01 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:01 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0a2236cb-9813-4ada-a39b-3e4f27d1e53f tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51a03b99-4bbb-4af7-aa4f-690731e8a127" returned: 0 in 0.263s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:01 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0a2236cb-9813-4ada-a39b-3e4f27d1e53f tempest-VolumesGetTest-150381411 None] Lock "cinder-quobyte-51a03b99-4bbb-4af7-aa4f-690731e8a127" released by "delete_volume" :: held 0.725s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:54:01 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-0a2236cb-9813-4ada-a39b-3e4f27d1e53f tempest-VolumesGetTest-150381411 None] Created reservations ['968084ec-5264-4fe5-9bfb-1625f9cd2437', '783e639b-043b-489b-aa72-3c7953e4d344', '9222d395-8156-4390-b84e-cfff7ef5bd73', 'c203b1f2-c408-4540-85a9-8a3c042bf64d'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:54:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0a2236cb-9813-4ada-a39b-3e4f27d1e53f tempest-VolumesGetTest-150381411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:54:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0a2236cb-9813-4ada-a39b-3e4f27d1e53f tempest-VolumesGetTest-150381411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:54:01 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0a2236cb-9813-4ada-a39b-3e4f27d1e53f tempest-VolumesGetTest-150381411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:54:01 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0a2236cb-9813-4ada-a39b-3e4f27d1e53f tempest-VolumesGetTest-150381411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:54:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0a2236cb-9813-4ada-a39b-3e4f27d1e53f tempest-VolumesGetTest-150381411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:54:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0a2236cb-9813-4ada-a39b-3e4f27d1e53f tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:02 devstack sudo[100356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:54:02 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:02 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0a2236cb-9813-4ada-a39b-3e4f27d1e53f tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.659s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:02 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-0a2236cb-9813-4ada-a39b-3e4f27d1e53f tempest-VolumesGetTest-150381411 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:54:02 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-0a2236cb-9813-4ada-a39b-3e4f27d1e53f tempest-VolumesGetTest-150381411 None] Deleted volume successfully. Sep 10 19:54:02 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0a2236cb-9813-4ada-a39b-3e4f27d1e53f tempest-VolumesGetTest-150381411 None] Lock "cinder-51a03b99-4bbb-4af7-aa4f-690731e8a127-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:54:03 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:54:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] Flow 'volume_create_manager' (5e6443de-a53f-4c33-a9bd-e8839ea50056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:54:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb967ac3-cc36-485a-99a3-dc52a2b54cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb967ac3-cc36-485a-99a3-dc52a2b54cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-558105657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd47223a-3794-479e-91d3-b27c2e7c61e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c39f3c07c94daf9bd50b0b6cbdb78b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:54:03Z,use_quota=True,user_id='1d61e9c0d15b4d7896d2ad1b9c988e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ddb543a-5e2a-4e12-8126-d7c108fb4f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ddb543a-5e2a-4e12-8126-d7c108fb4f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0233546-e2b1-4b4e-8860-5e43aa836131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0233546-e2b1-4b4e-8860-5e43aa836131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd47223a-3794-479e-91d3-b27c2e7c61e4', 'volume_name': 'volume-bd47223a-3794-479e-91d3-b27c2e7c61e4', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b895e1-763f-4f69-96e0-64d3bae2fd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b895e1-763f-4f69-96e0-64d3bae2fd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff5c6074-e3f2-41a2-80ef-01fda478e607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:03 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] Volume bd47223a-3794-479e-91d3-b27c2e7c61e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd47223a-3794-479e-91d3-b27c2e7c61e4', 'volume_size': 1} Sep 10 19:54:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:54:03 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:54:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:54:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:54:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:54:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:54:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:54:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:03 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:54:03 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:04 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.413s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:04 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:54:04 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager._thread_info {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:54:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread count: 28 {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 19:54:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread info: [<_MainThread(MainThread, started 138417491665024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 19:54:05 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5370452f-9b7e-445a-8573-942654dd3d47 tempest-VolumesActionsTest-1568259041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43 /opt/stack/data/cinder/conversion/5a940d3f-ef07-472a-8ba1-f59a1c076d43.temp_image.f07307aa-5105-4492-99ad-a9ee2b8c0fe5wg6pxvm0.img" returned: 0 in 4.268s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:05 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe1220e-332e-4510-997f-2e12a777705b]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:54:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5370452f-9b7e-445a-8573-942654dd3d47 tempest-VolumesActionsTest-1568259041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:05 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43 Sep 10 19:54:05 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:06 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5370452f-9b7e-445a-8573-942654dd3d47 tempest-VolumesActionsTest-1568259041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43" returned: 0 in 0.508s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:06 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-5370452f-9b7e-445a-8573-942654dd3d47 tempest-VolumesActionsTest-1568259041 None] Image conversion details: src /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43, size 1024.00 MB, duration 4.27 sec, destination /opt/stack/data/cinder/conversion/5a940d3f-ef07-472a-8ba1-f59a1c076d43.temp_image.f07307aa-5105-4492-99ad-a9ee2b8c0fe5wg6pxvm0.img {{(pid=88093) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 19:54:06 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-5370452f-9b7e-445a-8573-942654dd3d47 tempest-VolumesActionsTest-1568259041 None] Converted 1024.00 MB image at 239.90 MB/s Sep 10 19:54:06 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=143,cinder:UPDATE=170,cinder:INSERT=44,cinder:DELETE=7 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:54:06 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-5370452f-9b7e-445a-8573-942654dd3d47 tempest-VolumesActionsTest-1568259041 None] f07307aa-5105-4492-99ad-a9ee2b8c0fe5 was raw, no need to convert to raw {{(pid=88093) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 10 19:54:16 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=75,cinder:INSERT=20,cinder:UPDATE=73,cinder:DELETE=6 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:54:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5370452f-9b7e-445a-8573-942654dd3d47 tempest-VolumesActionsTest-1568259041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.695s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:54:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5370452f-9b7e-445a-8573-942654dd3d47 tempest-VolumesActionsTest-1568259041 None] Uploaded volume to glance image-id: f07307aa-5105-4492-99ad-a9ee2b8c0fe5. {{(pid=88093) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 10 19:54:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ec8c377c-809b-4b12-9df7-c44035d70bcd tempest-SnapshotsActionsTest-774626312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 24.248s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:54:25 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-ec8c377c-809b-4b12-9df7-c44035d70bcd tempest-SnapshotsActionsTest-774626312 None] Creating offline snapshot dfffc1c6-e21f-44b6-9662-07e479abe1ab of volume 6688cd76-af2a-4524-95ef-fdc2a62867a9 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 19:54:25 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-5370452f-9b7e-445a-8573-942654dd3d47 tempest-VolumesActionsTest-1568259041 None] Copy volume to image completed successfully. Sep 10 19:54:25 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22a9fbc-63b4-4a53-8e4e-8a1bc9ded351]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:54:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ec8c377c-809b-4b12-9df7-c44035d70bcd tempest-SnapshotsActionsTest-774626312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:25 devstack sudo[100374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9 Sep 10 19:54:25 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:25 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ec8c377c-809b-4b12-9df7-c44035d70bcd tempest-SnapshotsActionsTest-774626312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9" returned: 0 in 0.368s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ec8c377c-809b-4b12-9df7-c44035d70bcd tempest-SnapshotsActionsTest-774626312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:25 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab 1G Sep 10 19:54:25 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:26 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ec8c377c-809b-4b12-9df7-c44035d70bcd tempest-SnapshotsActionsTest-774626312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab 1G" returned: 0 in 0.412s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ec8c377c-809b-4b12-9df7-c44035d70bcd tempest-SnapshotsActionsTest-774626312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6688cd76-af2a-4524-95ef-fdc2a62867a9 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:26 devstack sudo[100386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6688cd76-af2a-4524-95ef-fdc2a62867a9 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab Sep 10 19:54:26 devstack sudo[100386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:26 devstack sudo[100386]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ec8c377c-809b-4b12-9df7-c44035d70bcd tempest-SnapshotsActionsTest-774626312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6688cd76-af2a-4524-95ef-fdc2a62867a9 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab" returned: 0 in 0.330s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:26 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-ec8c377c-809b-4b12-9df7-c44035d70bcd tempest-SnapshotsActionsTest-774626312 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab is being set with open permissions: ugo+rw Sep 10 19:54:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ec8c377c-809b-4b12-9df7-c44035d70bcd tempest-SnapshotsActionsTest-774626312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:26 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab Sep 10 19:54:26 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:26 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ec8c377c-809b-4b12-9df7-c44035d70bcd tempest-SnapshotsActionsTest-774626312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab" returned: 0 in 0.324s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ec8c377c-809b-4b12-9df7-c44035d70bcd tempest-SnapshotsActionsTest-774626312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:26 devstack sudo[100394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.info Sep 10 19:54:26 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:27 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ec8c377c-809b-4b12-9df7-c44035d70bcd tempest-SnapshotsActionsTest-774626312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.info" returned: 0 in 0.314s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:27 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-ec8c377c-809b-4b12-9df7-c44035d70bcd tempest-SnapshotsActionsTest-774626312 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.info is being set with open permissions: ugo+rw Sep 10 19:54:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ec8c377c-809b-4b12-9df7-c44035d70bcd tempest-SnapshotsActionsTest-774626312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:27 devstack sudo[100397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.info Sep 10 19:54:27 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-08d71bde-307b-4b02-91d2-26ac2dd3b19a tempest-VolumesActionsTest-1568259041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:54:27 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ec8c377c-809b-4b12-9df7-c44035d70bcd tempest-SnapshotsActionsTest-774626312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.info" returned: 0 in 0.262s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ec8c377c-809b-4b12-9df7-c44035d70bcd tempest-SnapshotsActionsTest-774626312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.130s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:54:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.168s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:54:27 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-558105657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd47223a-3794-479e-91d3-b27c2e7c61e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c39f3c07c94daf9bd50b0b6cbdb78b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:54:03Z,use_quota=True,user_id='1d61e9c0d15b4d7896d2ad1b9c988e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:54:27 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] Creating volume bd47223a-3794-479e-91d3-b27c2e7c61e4 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:54:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:54:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:54:27 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:54:27 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:54:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:54:27 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:54:27 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:54:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:27 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4 1073741824 Sep 10 19:54:27 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:27 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-ec8c377c-809b-4b12-9df7-c44035d70bcd tempest-SnapshotsActionsTest-774626312 None] Create snapshot completed successfully Sep 10 19:54:27 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4 1073741824" returned: 0 in 0.463s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:27 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4 Sep 10 19:54:27 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:28 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4" returned: 0 in 0.286s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:54:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:54:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-08d71bde-307b-4b02-91d2-26ac2dd3b19a tempest-VolumesActionsTest-1568259041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.959s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:54:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff5c6074-e3f2-41a2-80ef-01fda478e607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd47223a-3794-479e-91d3-b27c2e7c61e4', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d67a26b-9005-44e6-b50e-cbdde4d628eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:28 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcc02f7-addc-4719-9ad7-c6777d6f18da]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:54:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08d71bde-307b-4b02-91d2-26ac2dd3b19a tempest-VolumesActionsTest-1568259041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:28 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] Volume volume-bd47223a-3794-479e-91d3-b27c2e7c61e4 (bd47223a-3794-479e-91d3-b27c2e7c61e4): created successfully Sep 10 19:54:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d67a26b-9005-44e6-b50e-cbdde4d628eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] Flow 'volume_create_manager' (5e6443de-a53f-4c33-a9bd-e8839ea50056) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:54:28 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-6be682cf-e4dc-49a5-a783-d9caa6879424 tempest-VolumesGetTest-150381411 None] Created volume successfully. Sep 10 19:54:28 devstack sudo[100409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43 Sep 10 19:54:28 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:28 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08d71bde-307b-4b02-91d2-26ac2dd3b19a tempest-VolumesActionsTest-1568259041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43" returned: 0 in 0.413s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:28 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3cd0c2-d05c-4376-b3b0-06458ed685a8]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:54:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08d71bde-307b-4b02-91d2-26ac2dd3b19a tempest-VolumesActionsTest-1568259041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:28 devstack sudo[100414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43 Sep 10 19:54:28 devstack sudo[100414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-104b8404-efe3-462e-89d4-bd66e56fbe8c tempest-SnapshotsActionsTest-774626312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:54:29 devstack sudo[100414]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08d71bde-307b-4b02-91d2-26ac2dd3b19a tempest-VolumesActionsTest-1568259041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43" returned: 0 in 0.451s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08d71bde-307b-4b02-91d2-26ac2dd3b19a tempest-VolumesActionsTest-1568259041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43 /opt/stack/data/cinder/conversion/5a940d3f-ef07-472a-8ba1-f59a1c076d43.temp_image.58bd3c07-70b3-487d-bf57-5e559656be73b4vowhaw.img {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:29 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43 /opt/stack/data/cinder/conversion/5a940d3f-ef07-472a-8ba1-f59a1c076d43.temp_image.58bd3c07-70b3-487d-bf57-5e559656be73b4vowhaw.img Sep 10 19:54:29 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:29 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:54:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Flow 'volume_create_manager' (b1bf44f8-c26f-4c30-83b1-3beb1d89000a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:54:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6cda806-f96d-46f9-ba4b-9785244e9855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6cda806-f96d-46f9-ba4b-9785244e9855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1047848994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=559ec4c4-a529-4edb-a56b-2a239af5528c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='68c39f3c07c94daf9bd50b0b6cbdb78b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=bd47223a-3794-479e-91d3-b27c2e7c61e4,status='creating',terminated_at=None,updated_at=2026-09-10T17:54:29Z,use_quota=True,user_id='1d61e9c0d15b4d7896d2ad1b9c988e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31b28ad3-4966-487f-af7b-38d75c69c6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31b28ad3-4966-487f-af7b-38d75c69c6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de19b40-33f2-4730-b433-328f758d9719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de19b40-33f2-4730-b433-328f758d9719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '559ec4c4-a529-4edb-a56b-2a239af5528c', 'volume_name': 'volume-559ec4c4-a529-4edb-a56b-2a239af5528c', 'volume_size': 1, 'source_volid': 'bd47223a-3794-479e-91d3-b27c2e7c61e4', 'source_volstatus': 'available'}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9881a02-1fe9-437f-a1c7-ec9c7d080cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9881a02-1fe9-437f-a1c7-ec9c7d080cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4efcf17-7dd8-4837-937d-901703118937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:29 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Volume 559ec4c4-a529-4edb-a56b-2a239af5528c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-559ec4c4-a529-4edb-a56b-2a239af5528c', 'volume_size': 1, 'source_volid': 'bd47223a-3794-479e-91d3-b27c2e7c61e4', 'source_volstatus': 'available'} Sep 10 19:54:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:54:33 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08d71bde-307b-4b02-91d2-26ac2dd3b19a tempest-VolumesActionsTest-1568259041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43 /opt/stack/data/cinder/conversion/5a940d3f-ef07-472a-8ba1-f59a1c076d43.temp_image.58bd3c07-70b3-487d-bf57-5e559656be73b4vowhaw.img" returned: 0 in 3.915s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:33 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbda9ef2-94d9-474f-a416-8bc3def913fa]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:54:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08d71bde-307b-4b02-91d2-26ac2dd3b19a tempest-VolumesActionsTest-1568259041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:33 devstack sudo[100469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43 Sep 10 19:54:33 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:33 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08d71bde-307b-4b02-91d2-26ac2dd3b19a tempest-VolumesActionsTest-1568259041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43" returned: 0 in 0.508s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:33 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-08d71bde-307b-4b02-91d2-26ac2dd3b19a tempest-VolumesActionsTest-1568259041 None] Image conversion details: src /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43, size 1024.00 MB, duration 3.92 sec, destination /opt/stack/data/cinder/conversion/5a940d3f-ef07-472a-8ba1-f59a1c076d43.temp_image.58bd3c07-70b3-487d-bf57-5e559656be73b4vowhaw.img {{(pid=88093) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 19:54:33 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-08d71bde-307b-4b02-91d2-26ac2dd3b19a tempest-VolumesActionsTest-1568259041 None] Converted 1024.00 MB image at 261.48 MB/s Sep 10 19:54:33 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-08d71bde-307b-4b02-91d2-26ac2dd3b19a tempest-VolumesActionsTest-1568259041 None] 58bd3c07-70b3-487d-bf57-5e559656be73 was raw, converting to qcow2 {{(pid=88093) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 10 19:54:33 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e830bde-625f-4fba-bb97-8e44bc196cbe]: (4, 'raw') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:54:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08d71bde-307b-4b02-91d2-26ac2dd3b19a tempest-VolumesActionsTest-1568259041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5a940d3f-ef07-472a-8ba1-f59a1c076d43.temp_image.58bd3c07-70b3-487d-bf57-5e559656be73b4vowhaw.img {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:33 devstack sudo[100474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5a940d3f-ef07-472a-8ba1-f59a1c076d43.temp_image.58bd3c07-70b3-487d-bf57-5e559656be73b4vowhaw.img Sep 10 19:54:33 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:33 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08d71bde-307b-4b02-91d2-26ac2dd3b19a tempest-VolumesActionsTest-1568259041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5a940d3f-ef07-472a-8ba1-f59a1c076d43.temp_image.58bd3c07-70b3-487d-bf57-5e559656be73b4vowhaw.img" returned: 0 in 0.331s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08d71bde-307b-4b02-91d2-26ac2dd3b19a tempest-VolumesActionsTest-1568259041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5a940d3f-ef07-472a-8ba1-f59a1c076d43.temp_image.58bd3c07-70b3-487d-bf57-5e559656be73b4vowhaw.img {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:33 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5a940d3f-ef07-472a-8ba1-f59a1c076d43.temp_image.58bd3c07-70b3-487d-bf57-5e559656be73b4vowhaw.img Sep 10 19:54:33 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:34 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08d71bde-307b-4b02-91d2-26ac2dd3b19a tempest-VolumesActionsTest-1568259041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5a940d3f-ef07-472a-8ba1-f59a1c076d43.temp_image.58bd3c07-70b3-487d-bf57-5e559656be73b4vowhaw.img" returned: 1 in 0.308s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08d71bde-307b-4b02-91d2-26ac2dd3b19a tempest-VolumesActionsTest-1568259041 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5a940d3f-ef07-472a-8ba1-f59a1c076d43.temp_image.58bd3c07-70b3-487d-bf57-5e559656be73b4vowhaw.img' failed. Not Retrying. {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 19:54:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08d71bde-307b-4b02-91d2-26ac2dd3b19a tempest-VolumesActionsTest-1568259041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5a940d3f-ef07-472a-8ba1-f59a1c076d43.temp_image.58bd3c07-70b3-487d-bf57-5e559656be73b4vowhaw.img /opt/stack/data/cinder/conversion/vol_upload_vzgblimz {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:34 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5a940d3f-ef07-472a-8ba1-f59a1c076d43.temp_image.58bd3c07-70b3-487d-bf57-5e559656be73b4vowhaw.img /opt/stack/data/cinder/conversion/vol_upload_vzgblimz Sep 10 19:54:34 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:34 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08d71bde-307b-4b02-91d2-26ac2dd3b19a tempest-VolumesActionsTest-1568259041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5a940d3f-ef07-472a-8ba1-f59a1c076d43.temp_image.58bd3c07-70b3-487d-bf57-5e559656be73b4vowhaw.img /opt/stack/data/cinder/conversion/vol_upload_vzgblimz" returned: 0 in 0.245s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:34 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-08d71bde-307b-4b02-91d2-26ac2dd3b19a tempest-VolumesActionsTest-1568259041 None] Image conversion details: src /opt/stack/data/cinder/conversion/5a940d3f-ef07-472a-8ba1-f59a1c076d43.temp_image.58bd3c07-70b3-487d-bf57-5e559656be73b4vowhaw.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_vzgblimz {{(pid=88093) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 19:54:34 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-08d71bde-307b-4b02-91d2-26ac2dd3b19a tempest-VolumesActionsTest-1568259041 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 10 19:54:34 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[da782cdf-442a-4030-9774-3ad27556066e]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:54:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08d71bde-307b-4b02-91d2-26ac2dd3b19a tempest-VolumesActionsTest-1568259041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vzgblimz {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:34 devstack sudo[100488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vzgblimz Sep 10 19:54:34 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:34 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08d71bde-307b-4b02-91d2-26ac2dd3b19a tempest-VolumesActionsTest-1568259041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vzgblimz" returned: 0 in 0.359s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-08d71bde-307b-4b02-91d2-26ac2dd3b19a tempest-VolumesActionsTest-1568259041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.076s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:54:36 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-08d71bde-307b-4b02-91d2-26ac2dd3b19a tempest-VolumesActionsTest-1568259041 None] Uploaded volume to glance image-id: 58bd3c07-70b3-487d-bf57-5e559656be73. {{(pid=88093) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 10 19:54:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-104b8404-efe3-462e-89d4-bd66e56fbe8c tempest-SnapshotsActionsTest-774626312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.480s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:54:36 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-104b8404-efe3-462e-89d4-bd66e56fbe8c tempest-SnapshotsActionsTest-774626312 None] Creating offline snapshot b9a61c80-e270-4652-847e-e1e3963f0557 of volume 6688cd76-af2a-4524-95ef-fdc2a62867a9 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 19:54:36 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-08d71bde-307b-4b02-91d2-26ac2dd3b19a tempest-VolumesActionsTest-1568259041 None] Copy volume to image completed successfully. Sep 10 19:54:36 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79c2275-3915-4c60-b907-3b6e8e222e74]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:54:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-104b8404-efe3-462e-89d4-bd66e56fbe8c tempest-SnapshotsActionsTest-774626312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:36 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab Sep 10 19:54:36 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:36 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-104b8404-efe3-462e-89d4-bd66e56fbe8c tempest-SnapshotsActionsTest-774626312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab" returned: 0 in 0.375s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:36 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-104b8404-efe3-462e-89d4-bd66e56fbe8c tempest-SnapshotsActionsTest-774626312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6688cd76-af2a-4524-95ef-fdc2a62867a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:54:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-104b8404-efe3-462e-89d4-bd66e56fbe8c tempest-SnapshotsActionsTest-774626312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.b9a61c80-e270-4652-847e-e1e3963f0557 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:36 devstack sudo[100498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.b9a61c80-e270-4652-847e-e1e3963f0557 1G Sep 10 19:54:36 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:37 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-104b8404-efe3-462e-89d4-bd66e56fbe8c tempest-SnapshotsActionsTest-774626312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.b9a61c80-e270-4652-847e-e1e3963f0557 1G" returned: 0 in 0.477s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-104b8404-efe3-462e-89d4-bd66e56fbe8c tempest-SnapshotsActionsTest-774626312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.b9a61c80-e270-4652-847e-e1e3963f0557 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:37 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.b9a61c80-e270-4652-847e-e1e3963f0557 Sep 10 19:54:37 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-02c5a2d0-bdfc-4836-a1d2-a9991335e527 tempest-VolumesActionsTest-1568259041 None] Acquiring lock "cinder-5a940d3f-ef07-472a-8ba1-f59a1c076d43-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:54:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-02c5a2d0-bdfc-4836-a1d2-a9991335e527 tempest-VolumesActionsTest-1568259041 None] Lock "cinder-5a940d3f-ef07-472a-8ba1-f59a1c076d43-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:54:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-02c5a2d0-bdfc-4836-a1d2-a9991335e527 tempest-VolumesActionsTest-1568259041 None] Acquiring lock "cinder-quobyte-5a940d3f-ef07-472a-8ba1-f59a1c076d43" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:54:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-02c5a2d0-bdfc-4836-a1d2-a9991335e527 tempest-VolumesActionsTest-1568259041 None] Lock "cinder-quobyte-5a940d3f-ef07-472a-8ba1-f59a1c076d43" acquired by "delete_volume" :: waited 0.018s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:54:37 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa32304-baae-4dbc-bbc1-f44caf9285be]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:54:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-02c5a2d0-bdfc-4836-a1d2-a9991335e527 tempest-VolumesActionsTest-1568259041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:37 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-104b8404-efe3-462e-89d4-bd66e56fbe8c tempest-SnapshotsActionsTest-774626312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.b9a61c80-e270-4652-847e-e1e3963f0557" returned: 0 in 0.356s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:37 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-104b8404-efe3-462e-89d4-bd66e56fbe8c tempest-SnapshotsActionsTest-774626312 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.b9a61c80-e270-4652-847e-e1e3963f0557 is being set with open permissions: ugo+rw Sep 10 19:54:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-104b8404-efe3-462e-89d4-bd66e56fbe8c tempest-SnapshotsActionsTest-774626312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.b9a61c80-e270-4652-847e-e1e3963f0557 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:37 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.b9a61c80-e270-4652-847e-e1e3963f0557 Sep 10 19:54:37 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:37 devstack sudo[100509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43 Sep 10 19:54:37 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:37 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-104b8404-efe3-462e-89d4-bd66e56fbe8c tempest-SnapshotsActionsTest-774626312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.b9a61c80-e270-4652-847e-e1e3963f0557" returned: 0 in 0.267s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-104b8404-efe3-462e-89d4-bd66e56fbe8c tempest-SnapshotsActionsTest-774626312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.584s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:54:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.077s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:54:37 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Cloning volume bd47223a-3794-479e-91d3-b27c2e7c61e4 to volume 559ec4c4-a529-4edb-a56b-2a239af5528c Sep 10 19:54:37 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-02c5a2d0-bdfc-4836-a1d2-a9991335e527 tempest-VolumesActionsTest-1568259041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43" returned: 0 in 0.403s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-02c5a2d0-bdfc-4836-a1d2-a9991335e527 tempest-VolumesActionsTest-1568259041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:37 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-104b8404-efe3-462e-89d4-bd66e56fbe8c tempest-SnapshotsActionsTest-774626312 None] Create snapshot completed successfully Sep 10 19:54:37 devstack sudo[100518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43 Sep 10 19:54:37 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:37 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Creating offline snapshot 7c7086a6-3761-43f8-99cc-d02cec3749b8 of volume bd47223a-3794-479e-91d3-b27c2e7c61e4 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 19:54:37 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[683befc6-a4bb-4cd3-865c-e61aaa37f56f]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:54:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:38 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4 Sep 10 19:54:38 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:38 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-02c5a2d0-bdfc-4836-a1d2-a9991335e527 tempest-VolumesActionsTest-1568259041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5a940d3f-ef07-472a-8ba1-f59a1c076d43" returned: 0 in 0.271s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-02c5a2d0-bdfc-4836-a1d2-a9991335e527 tempest-VolumesActionsTest-1568259041 None] Lock "cinder-quobyte-5a940d3f-ef07-472a-8ba1-f59a1c076d43" released by "delete_volume" :: held 0.725s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:54:38 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-02c5a2d0-bdfc-4836-a1d2-a9991335e527 tempest-VolumesActionsTest-1568259041 None] Created reservations ['a3b32211-6925-4b23-9b4c-4dc0d4d20028', '239e2f57-375e-4edd-ab07-e6bf7f937739', '89935866-4724-408f-b2fc-169588a09421', '369a3b7a-1280-4e21-b6ce-a4476d186e56'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:54:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-02c5a2d0-bdfc-4836-a1d2-a9991335e527 tempest-VolumesActionsTest-1568259041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:54:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-02c5a2d0-bdfc-4836-a1d2-a9991335e527 tempest-VolumesActionsTest-1568259041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:54:38 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-02c5a2d0-bdfc-4836-a1d2-a9991335e527 tempest-VolumesActionsTest-1568259041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:54:38 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-02c5a2d0-bdfc-4836-a1d2-a9991335e527 tempest-VolumesActionsTest-1568259041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:54:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-02c5a2d0-bdfc-4836-a1d2-a9991335e527 tempest-VolumesActionsTest-1568259041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:54:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-02c5a2d0-bdfc-4836-a1d2-a9991335e527 tempest-VolumesActionsTest-1568259041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:38 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:54:38 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:38 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4" returned: 0 in 0.503s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4.7c7086a6-3761-43f8-99cc-d02cec3749b8 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:38 devstack sudo[100528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4.7c7086a6-3761-43f8-99cc-d02cec3749b8 1G Sep 10 19:54:38 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c183c1e6-3760-45b2-9d42-b052f5567d36 tempest-SnapshotsActionsTest-565968155 None] Acquiring lock "cinder-b9a61c80-e270-4652-847e-e1e3963f0557-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:54:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c183c1e6-3760-45b2-9d42-b052f5567d36 tempest-SnapshotsActionsTest-565968155 None] Lock "cinder-b9a61c80-e270-4652-847e-e1e3963f0557-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:54:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c183c1e6-3760-45b2-9d42-b052f5567d36 tempest-SnapshotsActionsTest-565968155 None] Acquiring lock "cinder-quobyte-6688cd76-af2a-4524-95ef-fdc2a62867a9" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:54:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c183c1e6-3760-45b2-9d42-b052f5567d36 tempest-SnapshotsActionsTest-565968155 None] Lock "cinder-quobyte-6688cd76-af2a-4524-95ef-fdc2a62867a9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:54:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c183c1e6-3760-45b2-9d42-b052f5567d36 tempest-SnapshotsActionsTest-565968155 None] Acquiring lock "cinder-quobyte-b9a61c80-e270-4652-847e-e1e3963f0557" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:54:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c183c1e6-3760-45b2-9d42-b052f5567d36 tempest-SnapshotsActionsTest-565968155 None] Lock "cinder-quobyte-b9a61c80-e270-4652-847e-e1e3963f0557" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:54:38 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-c183c1e6-3760-45b2-9d42-b052f5567d36 tempest-SnapshotsActionsTest-565968155 None] Deleting offline snapshot b9a61c80-e270-4652-847e-e1e3963f0557 of volume 6688cd76-af2a-4524-95ef-fdc2a62867a9 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 19:54:38 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-c183c1e6-3760-45b2-9d42-b052f5567d36 tempest-SnapshotsActionsTest-565968155 None] snapshot_file for this snap is: volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.b9a61c80-e270-4652-847e-e1e3963f0557 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 19:54:38 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd19b24f-5200-4db0-acd0-301f0c11266a]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:54:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c183c1e6-3760-45b2-9d42-b052f5567d36 tempest-SnapshotsActionsTest-565968155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.b9a61c80-e270-4652-847e-e1e3963f0557 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:38 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-02c5a2d0-bdfc-4836-a1d2-a9991335e527 tempest-VolumesActionsTest-1568259041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.329s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:38 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-02c5a2d0-bdfc-4836-a1d2-a9991335e527 tempest-VolumesActionsTest-1568259041 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:54:38 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-02c5a2d0-bdfc-4836-a1d2-a9991335e527 tempest-VolumesActionsTest-1568259041 None] Deleted volume successfully. Sep 10 19:54:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-02c5a2d0-bdfc-4836-a1d2-a9991335e527 tempest-VolumesActionsTest-1568259041 None] Lock "cinder-5a940d3f-ef07-472a-8ba1-f59a1c076d43-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:54:38 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.b9a61c80-e270-4652-847e-e1e3963f0557 Sep 10 19:54:38 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:39 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4.7c7086a6-3761-43f8-99cc-d02cec3749b8 1G" returned: 0 in 0.564s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd47223a-3794-479e-91d3-b27c2e7c61e4 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4.7c7086a6-3761-43f8-99cc-d02cec3749b8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:39 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd47223a-3794-479e-91d3-b27c2e7c61e4 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4.7c7086a6-3761-43f8-99cc-d02cec3749b8 Sep 10 19:54:39 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:39 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c183c1e6-3760-45b2-9d42-b052f5567d36 tempest-SnapshotsActionsTest-565968155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.b9a61c80-e270-4652-847e-e1e3963f0557" returned: 0 in 0.492s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:39 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-c183c1e6-3760-45b2-9d42-b052f5567d36 tempest-SnapshotsActionsTest-565968155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6688cd76-af2a-4524-95ef-fdc2a62867a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:54:39 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[6869ab2c-d923-45e2-8684-4e6890f3d157]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:54:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c183c1e6-3760-45b2-9d42-b052f5567d36 tempest-SnapshotsActionsTest-565968155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:39 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab Sep 10 19:54:39 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:39 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd47223a-3794-479e-91d3-b27c2e7c61e4 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4.7c7086a6-3761-43f8-99cc-d02cec3749b8" returned: 0 in 0.345s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:39 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4.7c7086a6-3761-43f8-99cc-d02cec3749b8 is being set with open permissions: ugo+rw Sep 10 19:54:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4.7c7086a6-3761-43f8-99cc-d02cec3749b8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:39 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4.7c7086a6-3761-43f8-99cc-d02cec3749b8 Sep 10 19:54:39 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:39 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4.7c7086a6-3761-43f8-99cc-d02cec3749b8" returned: 0 in 0.348s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:39 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c183c1e6-3760-45b2-9d42-b052f5567d36 tempest-SnapshotsActionsTest-565968155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab" returned: 0 in 0.564s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:39 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-c183c1e6-3760-45b2-9d42-b052f5567d36 tempest-SnapshotsActionsTest-565968155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6688cd76-af2a-4524-95ef-fdc2a62867a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:54:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c183c1e6-3760-45b2-9d42-b052f5567d36 tempest-SnapshotsActionsTest-565968155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.b9a61c80-e270-4652-847e-e1e3963f0557 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:39 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.b9a61c80-e270-4652-847e-e1e3963f0557 Sep 10 19:54:39 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:39 devstack sudo[100557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4.info Sep 10 19:54:39 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:40 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4.info" returned: 0 in 0.315s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:40 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4.info is being set with open permissions: ugo+rw Sep 10 19:54:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:40 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4.info Sep 10 19:54:40 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:40 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c183c1e6-3760-45b2-9d42-b052f5567d36 tempest-SnapshotsActionsTest-565968155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.b9a61c80-e270-4652-847e-e1e3963f0557" returned: 0 in 0.484s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c183c1e6-3760-45b2-9d42-b052f5567d36 tempest-SnapshotsActionsTest-565968155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.b9a61c80-e270-4652-847e-e1e3963f0557 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:40 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.b9a61c80-e270-4652-847e-e1e3963f0557 Sep 10 19:54:40 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:40 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4.info" returned: 0 in 0.326s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:40 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Acquiring lock "cinder-quobyte-559ec4c4-a529-4edb-a56b-2a239af5528c" by "_copy_volume_from_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:54:40 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Lock "cinder-quobyte-559ec4c4-a529-4edb-a56b-2a239af5528c" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:54:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] snapshot: 7c7086a6-3761-43f8-99cc-d02cec3749b8, volume: 559ec4c4-a529-4edb-a56b-2a239af5528c, {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 19:54:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:54:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:54:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:54:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:54:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:54:40 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f42b20-b388-4244-91cf-b77322b329cc]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:54:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4.7c7086a6-3761-43f8-99cc-d02cec3749b8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:40 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c183c1e6-3760-45b2-9d42-b052f5567d36 tempest-SnapshotsActionsTest-565968155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.b9a61c80-e270-4652-847e-e1e3963f0557" returned: 0 in 0.286s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:40 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c183c1e6-3760-45b2-9d42-b052f5567d36 tempest-SnapshotsActionsTest-565968155 None] Lock "cinder-quobyte-b9a61c80-e270-4652-847e-e1e3963f0557" released by "_delete_snapshot" :: held 1.996s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:54:40 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c183c1e6-3760-45b2-9d42-b052f5567d36 tempest-SnapshotsActionsTest-565968155 None] Lock "cinder-quobyte-6688cd76-af2a-4524-95ef-fdc2a62867a9" released by "delete_snapshot" :: held 2.034s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:54:40 devstack sudo[100570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4.7c7086a6-3761-43f8-99cc-d02cec3749b8 Sep 10 19:54:40 devstack sudo[100570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:40 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-c183c1e6-3760-45b2-9d42-b052f5567d36 tempest-SnapshotsActionsTest-565968155 None] Created reservations ['9a1700fe-05c9-4e96-bfac-f124a4d41612', 'c6a561e6-5514-4824-a8a8-5935c22dbd26', 'f77970ae-e680-476b-8304-c0a16456b0b5', '4e5c9477-04b3-4c52-a77e-2d2e4056be25'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:54:40 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-c183c1e6-3760-45b2-9d42-b052f5567d36 tempest-SnapshotsActionsTest-565968155 None] Delete snapshot completed successfully. Sep 10 19:54:40 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c183c1e6-3760-45b2-9d42-b052f5567d36 tempest-SnapshotsActionsTest-565968155 None] Lock "cinder-b9a61c80-e270-4652-847e-e1e3963f0557-delete_snapshot" released by "delete_snapshot" :: held 2.245s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:54:40 devstack sudo[100570]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4.7c7086a6-3761-43f8-99cc-d02cec3749b8" returned: 0 in 0.420s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd47223a-3794-479e-91d3-b27c2e7c61e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:54:40 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12c1c94-b5da-484f-8b33-c23c51fdb6d7]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:54:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:41 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4 Sep 10 19:54:41 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:41 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4" returned: 0 in 0.436s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4 {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 19:54:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Creating direct copy from snapshot {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 19:54:41 devstack cinder-volume[88093]: DEBUG cinder.utils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Path /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-559ec4c4-a529-4edb-a56b-2a239af5528c not found in is_blk_device check {{(pid=88093) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 19:54:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-559ec4c4-a529-4edb-a56b-2a239af5528c {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:41 devstack sudo[100580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-559ec4c4-a529-4edb-a56b-2a239af5528c Sep 10 19:54:41 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ff83a3d9-26f7-475c-a6b8-fba2bcfbf4eb tempest-SnapshotsActionsTest-774626312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:54:46 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-559ec4c4-a529-4edb-a56b-2a239af5528c" returned: 0 in 5.315s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:46 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Image conversion details: src /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4, size 1024.00 MB, duration 5.32 sec, destination /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-559ec4c4-a529-4edb-a56b-2a239af5528c {{(pid=88093) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 19:54:46 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Converted 1024.00 MB image at 192.62 MB/s Sep 10 19:54:46 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-559ec4c4-a529-4edb-a56b-2a239af5528c is being set with open permissions: ugo+rw Sep 10 19:54:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-559ec4c4-a529-4edb-a56b-2a239af5528c {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:46 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-559ec4c4-a529-4edb-a56b-2a239af5528c Sep 10 19:54:46 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:46 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-559ec4c4-a529-4edb-a56b-2a239af5528c" returned: 0 in 0.262s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:46 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Lock "cinder-quobyte-559ec4c4-a529-4edb-a56b-2a239af5528c" released by "_copy_volume_from_snapshot" :: held 6.524s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:54:46 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Acquiring lock "cinder-quobyte-7c7086a6-3761-43f8-99cc-d02cec3749b8" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:54:46 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Lock "cinder-quobyte-7c7086a6-3761-43f8-99cc-d02cec3749b8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:54:47 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Deleting offline snapshot 7c7086a6-3761-43f8-99cc-d02cec3749b8 of volume bd47223a-3794-479e-91d3-b27c2e7c61e4 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 19:54:47 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] snapshot_file for this snap is: volume-bd47223a-3794-479e-91d3-b27c2e7c61e4.7c7086a6-3761-43f8-99cc-d02cec3749b8 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 19:54:47 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cc6d6e-cd2b-4dd4-a1c8-51fc62638dfe]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:54:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4.7c7086a6-3761-43f8-99cc-d02cec3749b8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:47 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4.7c7086a6-3761-43f8-99cc-d02cec3749b8 Sep 10 19:54:47 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:47 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4.7c7086a6-3761-43f8-99cc-d02cec3749b8" returned: 0 in 0.444s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:47 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd47223a-3794-479e-91d3-b27c2e7c61e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:54:47 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[0780046c-a750-4460-8331-30dfb353ab25]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:54:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:47 devstack sudo[100609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4 Sep 10 19:54:47 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:48 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4" returned: 0 in 0.560s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4.7c7086a6-3761-43f8-99cc-d02cec3749b8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:48 devstack sudo[100614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4.7c7086a6-3761-43f8-99cc-d02cec3749b8 Sep 10 19:54:48 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:48 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4.7c7086a6-3761-43f8-99cc-d02cec3749b8" returned: 0 in 0.379s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4.7c7086a6-3761-43f8-99cc-d02cec3749b8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:48 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4.7c7086a6-3761-43f8-99cc-d02cec3749b8 Sep 10 19:54:48 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:48 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4.7c7086a6-3761-43f8-99cc-d02cec3749b8" returned: 0 in 0.321s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:48 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Lock "cinder-quobyte-7c7086a6-3761-43f8-99cc-d02cec3749b8" released by "_delete_snapshot" :: held 1.818s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:54:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:54:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ff83a3d9-26f7-475c-a6b8-fba2bcfbf4eb tempest-SnapshotsActionsTest-774626312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.460s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:54:48 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-ff83a3d9-26f7-475c-a6b8-fba2bcfbf4eb tempest-SnapshotsActionsTest-774626312 None] Creating offline snapshot 392a19d2-9f1c-4028-874a-cc78e0166ae3 of volume 6688cd76-af2a-4524-95ef-fdc2a62867a9 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 19:54:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4efcf17-7dd8-4837-937d-901703118937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-559ec4c4-a529-4edb-a56b-2a239af5528c', 'volume_size': 1, 'source_volid': 'bd47223a-3794-479e-91d3-b27c2e7c61e4', 'source_volstatus': 'available'}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e429afab-60e4-4fcb-82e2-9b5a64be4c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:48 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5143a7e-be76-4eed-a957-968f5a32d838]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:54:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ff83a3d9-26f7-475c-a6b8-fba2bcfbf4eb tempest-SnapshotsActionsTest-774626312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:48 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Volume volume-559ec4c4-a529-4edb-a56b-2a239af5528c (559ec4c4-a529-4edb-a56b-2a239af5528c): created successfully Sep 10 19:54:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e429afab-60e4-4fcb-82e2-9b5a64be4c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Flow 'volume_create_manager' (b1bf44f8-c26f-4c30-83b1-3beb1d89000a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:54:48 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-cf88dbb0-aa57-4436-b8d1-3be941bb409d tempest-VolumesGetTest-150381411 None] Created volume successfully. Sep 10 19:54:49 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab Sep 10 19:54:49 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:49 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ff83a3d9-26f7-475c-a6b8-fba2bcfbf4eb tempest-SnapshotsActionsTest-774626312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab" returned: 0 in 0.434s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-ff83a3d9-26f7-475c-a6b8-fba2bcfbf4eb tempest-SnapshotsActionsTest-774626312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6688cd76-af2a-4524-95ef-fdc2a62867a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:54:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ff83a3d9-26f7-475c-a6b8-fba2bcfbf4eb tempest-SnapshotsActionsTest-774626312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.392a19d2-9f1c-4028-874a-cc78e0166ae3 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:49 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.392a19d2-9f1c-4028-874a-cc78e0166ae3 1G Sep 10 19:54:49 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:49 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:54:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] Flow 'volume_create_manager' (0c29850b-68f6-4881-8ea1-5b0e9cde6ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:54:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d171ca1-75d3-4e7e-8907-4816113b1301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d171ca1-75d3-4e7e-8907-4816113b1301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-410200582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bece030b-67e3-4ef9-b615-40c57f31b5c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d49af4a5ed943e1892150ed4275d458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:54:50Z,use_quota=True,user_id='6b4f248250cc469597f2374a43be8e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad2644c-1ee9-43f1-8102-547ca5aae2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad2644c-1ee9-43f1-8102-547ca5aae2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0944ea24-cebf-42a1-9f8a-776bb11bf9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0944ea24-cebf-42a1-9f8a-776bb11bf9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bece030b-67e3-4ef9-b615-40c57f31b5c7', 'volume_name': 'volume-bece030b-67e3-4ef9-b615-40c57f31b5c7', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e4799d-1b55-4593-87a7-e3f8296578dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e4799d-1b55-4593-87a7-e3f8296578dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bfc86e3-8772-4221-9f7e-0d61231b1a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:49 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] Volume bece030b-67e3-4ef9-b615-40c57f31b5c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bece030b-67e3-4ef9-b615-40c57f31b5c7', 'volume_size': 1} Sep 10 19:54:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:54:49 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ff83a3d9-26f7-475c-a6b8-fba2bcfbf4eb tempest-SnapshotsActionsTest-774626312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.392a19d2-9f1c-4028-874a-cc78e0166ae3 1G" returned: 0 in 0.580s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ff83a3d9-26f7-475c-a6b8-fba2bcfbf4eb tempest-SnapshotsActionsTest-774626312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.392a19d2-9f1c-4028-874a-cc78e0166ae3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:49 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.392a19d2-9f1c-4028-874a-cc78e0166ae3 Sep 10 19:54:50 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:50 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:54:50 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] Flow 'volume_create_manager' (35e30405-8667-413e-b97f-bdcf7ce1b09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:54:50 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b41433ba-7f35-4eae-8cb1-c265798cb70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:50 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b41433ba-7f35-4eae-8cb1-c265798cb70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:54:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-419586788',display_name='tempest-VolumesGetTest-Volume-1139512937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcccefdd-c214-4c4c-9ecf-116a6d82b9d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c39f3c07c94daf9bd50b0b6cbdb78b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:54:50Z,use_quota=True,user_id='1d61e9c0d15b4d7896d2ad1b9c988e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:50 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de16137-24c6-4812-a763-783b69542c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:50 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de16137-24c6-4812-a763-783b69542c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:50 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a1b674-4fb0-4645-a539-b4a43c3adb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:50 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:50 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a1b674-4fb0-4645-a539-b4a43c3adb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcccefdd-c214-4c4c-9ecf-116a6d82b9d8', 'volume_name': 'volume-dcccefdd-c214-4c4c-9ecf-116a6d82b9d8', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:50 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5189e736-7bd1-4c43-b16c-44e55d3ca29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:50 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5189e736-7bd1-4c43-b16c-44e55d3ca29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:50 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a08532-7f7e-4cbb-9d1c-af2aa3d82961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:50 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] Volume dcccefdd-c214-4c4c-9ecf-116a6d82b9d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcccefdd-c214-4c4c-9ecf-116a6d82b9d8', 'volume_size': 1} Sep 10 19:54:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:54:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ff83a3d9-26f7-475c-a6b8-fba2bcfbf4eb tempest-SnapshotsActionsTest-774626312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.392a19d2-9f1c-4028-874a-cc78e0166ae3" returned: 0 in 0.456s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:50 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-ff83a3d9-26f7-475c-a6b8-fba2bcfbf4eb tempest-SnapshotsActionsTest-774626312 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.392a19d2-9f1c-4028-874a-cc78e0166ae3 is being set with open permissions: ugo+rw Sep 10 19:54:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ff83a3d9-26f7-475c-a6b8-fba2bcfbf4eb tempest-SnapshotsActionsTest-774626312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.392a19d2-9f1c-4028-874a-cc78e0166ae3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:50 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.392a19d2-9f1c-4028-874a-cc78e0166ae3 Sep 10 19:54:50 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:50 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ff83a3d9-26f7-475c-a6b8-fba2bcfbf4eb tempest-SnapshotsActionsTest-774626312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.392a19d2-9f1c-4028-874a-cc78e0166ae3" returned: 0 in 0.297s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ff83a3d9-26f7-475c-a6b8-fba2bcfbf4eb tempest-SnapshotsActionsTest-774626312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.895s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:54:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.982s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:54:50 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-410200582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bece030b-67e3-4ef9-b615-40c57f31b5c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d49af4a5ed943e1892150ed4275d458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:54:50Z,use_quota=True,user_id='6b4f248250cc469597f2374a43be8e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:54:50 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] Creating volume bece030b-67e3-4ef9-b615-40c57f31b5c7 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:54:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:54:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:54:50 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:54:50 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:54:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:54:50 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:54:50 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:54:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:50 devstack sudo[100645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7 1073741824 Sep 10 19:54:50 devstack sudo[100645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:50 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-ff83a3d9-26f7-475c-a6b8-fba2bcfbf4eb tempest-SnapshotsActionsTest-774626312 None] Create snapshot completed successfully Sep 10 19:54:51 devstack sudo[100645]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7 1073741824" returned: 0 in 0.538s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:51 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7 Sep 10 19:54:51 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:51 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7" returned: 0 in 0.260s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:54:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:54:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.190s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:54:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:54:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-419586788',display_name='tempest-VolumesGetTest-Volume-1139512937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcccefdd-c214-4c4c-9ecf-116a6d82b9d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c39f3c07c94daf9bd50b0b6cbdb78b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:54:50Z,use_quota=True,user_id='1d61e9c0d15b4d7896d2ad1b9c988e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:54:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] Creating volume dcccefdd-c214-4c4c-9ecf-116a6d82b9d8 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:54:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:54:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:54:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:54:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:54:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:54:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:54:51 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:54:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-dcccefdd-c214-4c4c-9ecf-116a6d82b9d8 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:51 devstack sudo[100653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-dcccefdd-c214-4c4c-9ecf-116a6d82b9d8 1073741824 Sep 10 19:54:51 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bfc86e3-8772-4221-9f7e-0d61231b1a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bece030b-67e3-4ef9-b615-40c57f31b5c7', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6038149-beba-4899-b510-07b59c9f47e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:51 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] Volume volume-bece030b-67e3-4ef9-b615-40c57f31b5c7 (bece030b-67e3-4ef9-b615-40c57f31b5c7): created successfully Sep 10 19:54:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6038149-beba-4899-b510-07b59c9f47e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] Flow 'volume_create_manager' (0c29850b-68f6-4881-8ea1-5b0e9cde6ee0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:54:51 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-9267c169-b7cb-4192-8aca-c15c517f7cb6 tempest-VolumesCloneTest-2098235866 None] Created volume successfully. Sep 10 19:54:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5d0a8193-c01d-4127-9a80-ffa6cd3a0543 tempest-SnapshotsActionsTest-565968155 None] Acquiring lock "cinder-392a19d2-9f1c-4028-874a-cc78e0166ae3-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:54:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5d0a8193-c01d-4127-9a80-ffa6cd3a0543 tempest-SnapshotsActionsTest-565968155 None] Lock "cinder-392a19d2-9f1c-4028-874a-cc78e0166ae3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:54:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5d0a8193-c01d-4127-9a80-ffa6cd3a0543 tempest-SnapshotsActionsTest-565968155 None] Acquiring lock "cinder-quobyte-6688cd76-af2a-4524-95ef-fdc2a62867a9" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:54:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5d0a8193-c01d-4127-9a80-ffa6cd3a0543 tempest-SnapshotsActionsTest-565968155 None] Lock "cinder-quobyte-6688cd76-af2a-4524-95ef-fdc2a62867a9" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:54:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5d0a8193-c01d-4127-9a80-ffa6cd3a0543 tempest-SnapshotsActionsTest-565968155 None] Acquiring lock "cinder-quobyte-392a19d2-9f1c-4028-874a-cc78e0166ae3" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:54:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5d0a8193-c01d-4127-9a80-ffa6cd3a0543 tempest-SnapshotsActionsTest-565968155 None] Lock "cinder-quobyte-392a19d2-9f1c-4028-874a-cc78e0166ae3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:54:52 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-5d0a8193-c01d-4127-9a80-ffa6cd3a0543 tempest-SnapshotsActionsTest-565968155 None] Deleting offline snapshot 392a19d2-9f1c-4028-874a-cc78e0166ae3 of volume 6688cd76-af2a-4524-95ef-fdc2a62867a9 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 19:54:52 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-5d0a8193-c01d-4127-9a80-ffa6cd3a0543 tempest-SnapshotsActionsTest-565968155 None] snapshot_file for this snap is: volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.392a19d2-9f1c-4028-874a-cc78e0166ae3 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 19:54:52 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[809f5974-4ab5-4132-a8ff-a8091263ce7d]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:54:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5d0a8193-c01d-4127-9a80-ffa6cd3a0543 tempest-SnapshotsActionsTest-565968155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.392a19d2-9f1c-4028-874a-cc78e0166ae3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:52 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-dcccefdd-c214-4c4c-9ecf-116a6d82b9d8 1073741824" returned: 0 in 0.598s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-dcccefdd-c214-4c4c-9ecf-116a6d82b9d8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:52 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.392a19d2-9f1c-4028-874a-cc78e0166ae3 Sep 10 19:54:52 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:52 devstack sudo[100661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-dcccefdd-c214-4c4c-9ecf-116a6d82b9d8 Sep 10 19:54:52 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:52 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5d0a8193-c01d-4127-9a80-ffa6cd3a0543 tempest-SnapshotsActionsTest-565968155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.392a19d2-9f1c-4028-874a-cc78e0166ae3" returned: 0 in 0.427s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:52 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-5d0a8193-c01d-4127-9a80-ffa6cd3a0543 tempest-SnapshotsActionsTest-565968155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6688cd76-af2a-4524-95ef-fdc2a62867a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:54:52 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[83db1118-36b3-4fe1-b630-5737dd223388]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:54:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5d0a8193-c01d-4127-9a80-ffa6cd3a0543 tempest-SnapshotsActionsTest-565968155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:52 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-dcccefdd-c214-4c4c-9ecf-116a6d82b9d8" returned: 0 in 0.371s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:52 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:54:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:54:52 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a08532-7f7e-4cbb-9d1c-af2aa3d82961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcccefdd-c214-4c4c-9ecf-116a6d82b9d8', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:52 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf90dbc3-d35d-487f-b056-f380c8c13b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:52 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] Volume volume-dcccefdd-c214-4c4c-9ecf-116a6d82b9d8 (dcccefdd-c214-4c4c-9ecf-116a6d82b9d8): created successfully Sep 10 19:54:52 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf90dbc3-d35d-487f-b056-f380c8c13b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:52 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab Sep 10 19:54:52 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:52 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] Flow 'volume_create_manager' (35e30405-8667-413e-b97f-bdcf7ce1b09c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:54:52 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-0abc19a6-0896-4983-bea4-fc8f729ca596 tempest-VolumesGetTest-150381411 None] Created volume successfully. Sep 10 19:54:52 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5d0a8193-c01d-4127-9a80-ffa6cd3a0543 tempest-SnapshotsActionsTest-565968155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab" returned: 0 in 0.400s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:53 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-5d0a8193-c01d-4127-9a80-ffa6cd3a0543 tempest-SnapshotsActionsTest-565968155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6688cd76-af2a-4524-95ef-fdc2a62867a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:54:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5d0a8193-c01d-4127-9a80-ffa6cd3a0543 tempest-SnapshotsActionsTest-565968155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.392a19d2-9f1c-4028-874a-cc78e0166ae3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:53 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.392a19d2-9f1c-4028-874a-cc78e0166ae3 Sep 10 19:54:53 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:53 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5d0a8193-c01d-4127-9a80-ffa6cd3a0543 tempest-SnapshotsActionsTest-565968155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.392a19d2-9f1c-4028-874a-cc78e0166ae3" returned: 0 in 0.446s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5d0a8193-c01d-4127-9a80-ffa6cd3a0543 tempest-SnapshotsActionsTest-565968155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.392a19d2-9f1c-4028-874a-cc78e0166ae3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:53 devstack sudo[100679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.392a19d2-9f1c-4028-874a-cc78e0166ae3 Sep 10 19:54:53 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:53 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:54:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Flow 'volume_create_manager' (6964a978-d1e8-4442-bfdb-17fbeea14045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:54:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65a23745-4504-464f-8753-92da0565a55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65a23745-4504-464f-8753-92da0565a55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1887931436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=747bf1c3-553e-4260-b9d9-7bd6bad506fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d49af4a5ed943e1892150ed4275d458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:54:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=bece030b-67e3-4ef9-b615-40c57f31b5c7,status='creating',terminated_at=None,updated_at=2026-09-10T17:54:53Z,use_quota=True,user_id='6b4f248250cc469597f2374a43be8e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f6d3aa-f35e-42cd-9186-749fdd824e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f6d3aa-f35e-42cd-9186-749fdd824e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a37208-a93a-401b-aceb-0c234959ae26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a37208-a93a-401b-aceb-0c234959ae26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '747bf1c3-553e-4260-b9d9-7bd6bad506fb', 'volume_name': 'volume-747bf1c3-553e-4260-b9d9-7bd6bad506fb', 'volume_size': 2, 'source_volid': 'bece030b-67e3-4ef9-b615-40c57f31b5c7', 'source_volstatus': 'available'}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a7e97d-8571-4edc-b061-88b9e4e0dd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a7e97d-8571-4edc-b061-88b9e4e0dd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8730d7-48c3-436a-87f0-0a6fbef5e3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:53 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Volume 747bf1c3-553e-4260-b9d9-7bd6bad506fb: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-747bf1c3-553e-4260-b9d9-7bd6bad506fb', 'volume_size': 2, 'source_volid': 'bece030b-67e3-4ef9-b615-40c57f31b5c7', 'source_volstatus': 'available'} Sep 10 19:54:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:54:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:54:53 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Cloning volume bece030b-67e3-4ef9-b615-40c57f31b5c7 to volume 747bf1c3-553e-4260-b9d9-7bd6bad506fb Sep 10 19:54:53 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Creating offline snapshot b9b5f3a3-12d3-4b84-88fb-3a8c46f7d110 of volume bece030b-67e3-4ef9-b615-40c57f31b5c7 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 19:54:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-15e7af80-6519-4477-a131-c5a8df536b7b tempest-VolumesGetTest-150381411 None] Acquiring lock "cinder-dcccefdd-c214-4c4c-9ecf-116a6d82b9d8-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:54:53 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c1ac38-4240-4ea5-9357-0c3cbc5fb11f]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:54:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-15e7af80-6519-4477-a131-c5a8df536b7b tempest-VolumesGetTest-150381411 None] Lock "cinder-dcccefdd-c214-4c4c-9ecf-116a6d82b9d8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:54:53 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5d0a8193-c01d-4127-9a80-ffa6cd3a0543 tempest-SnapshotsActionsTest-565968155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.392a19d2-9f1c-4028-874a-cc78e0166ae3" returned: 0 in 0.306s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5d0a8193-c01d-4127-9a80-ffa6cd3a0543 tempest-SnapshotsActionsTest-565968155 None] Lock "cinder-quobyte-392a19d2-9f1c-4028-874a-cc78e0166ae3" released by "_delete_snapshot" :: held 1.701s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:54:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5d0a8193-c01d-4127-9a80-ffa6cd3a0543 tempest-SnapshotsActionsTest-565968155 None] Lock "cinder-quobyte-6688cd76-af2a-4524-95ef-fdc2a62867a9" released by "delete_snapshot" :: held 1.733s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:54:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-15e7af80-6519-4477-a131-c5a8df536b7b tempest-VolumesGetTest-150381411 None] Acquiring lock "cinder-quobyte-dcccefdd-c214-4c4c-9ecf-116a6d82b9d8" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:54:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-15e7af80-6519-4477-a131-c5a8df536b7b tempest-VolumesGetTest-150381411 None] Lock "cinder-quobyte-dcccefdd-c214-4c4c-9ecf-116a6d82b9d8" acquired by "delete_volume" :: waited 0.020s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:54:53 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7 Sep 10 19:54:53 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:53 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fc3caa-bd42-47f7-99bf-bff9a2d8de81]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:54:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-15e7af80-6519-4477-a131-c5a8df536b7b tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-dcccefdd-c214-4c4c-9ecf-116a6d82b9d8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:53 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-5d0a8193-c01d-4127-9a80-ffa6cd3a0543 tempest-SnapshotsActionsTest-565968155 None] Created reservations ['af55d261-869d-4478-b987-76a368861a60', 'cf6f7acd-3f53-4741-a9d9-3d714c065f95', '5be1c2a7-ec14-4130-bf14-e0d9c9b44517', '8b82c0d0-a56d-4862-83a3-6d3452ff09bc'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:54:53 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-5d0a8193-c01d-4127-9a80-ffa6cd3a0543 tempest-SnapshotsActionsTest-565968155 None] Delete snapshot completed successfully. Sep 10 19:54:54 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5d0a8193-c01d-4127-9a80-ffa6cd3a0543 tempest-SnapshotsActionsTest-565968155 None] Lock "cinder-392a19d2-9f1c-4028-874a-cc78e0166ae3-delete_snapshot" released by "delete_snapshot" :: held 1.949s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:54:54 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-dcccefdd-c214-4c4c-9ecf-116a6d82b9d8 Sep 10 19:54:54 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:54 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7" returned: 0 in 0.416s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7.b9b5f3a3-12d3-4b84-88fb-3a8c46f7d110 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:54 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7.b9b5f3a3-12d3-4b84-88fb-3a8c46f7d110 1G Sep 10 19:54:54 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:54 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-15e7af80-6519-4477-a131-c5a8df536b7b tempest-VolumesGetTest-150381411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-dcccefdd-c214-4c4c-9ecf-116a6d82b9d8" returned: 0 in 0.450s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-15e7af80-6519-4477-a131-c5a8df536b7b tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-dcccefdd-c214-4c4c-9ecf-116a6d82b9d8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:54 devstack sudo[100694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-dcccefdd-c214-4c4c-9ecf-116a6d82b9d8 Sep 10 19:54:54 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e2e6b45b-8cdb-42de-b4f5-1379be279240 tempest-SnapshotsActionsTest-774626312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:54:54 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-15e7af80-6519-4477-a131-c5a8df536b7b tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-dcccefdd-c214-4c4c-9ecf-116a6d82b9d8" returned: 0 in 0.287s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:54 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-15e7af80-6519-4477-a131-c5a8df536b7b tempest-VolumesGetTest-150381411 None] Lock "cinder-quobyte-dcccefdd-c214-4c4c-9ecf-116a6d82b9d8" released by "delete_volume" :: held 0.792s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:54:54 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7.b9b5f3a3-12d3-4b84-88fb-3a8c46f7d110 1G" returned: 0 in 0.508s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bece030b-67e3-4ef9-b615-40c57f31b5c7 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7.b9b5f3a3-12d3-4b84-88fb-3a8c46f7d110 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:54 devstack sudo[100701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bece030b-67e3-4ef9-b615-40c57f31b5c7 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7.b9b5f3a3-12d3-4b84-88fb-3a8c46f7d110 Sep 10 19:54:54 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:54 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-15e7af80-6519-4477-a131-c5a8df536b7b tempest-VolumesGetTest-150381411 None] Created reservations ['8fa3e629-fa82-42a3-b642-21aa18885cc6', '948e86df-dfc7-49fc-94d3-4213063a12bd', '14ec8288-b9f3-487f-a972-44fe15a709f9', '3b279a28-6024-467d-bfe9-e1a64c7e463e'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:54:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-15e7af80-6519-4477-a131-c5a8df536b7b tempest-VolumesGetTest-150381411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:54:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-15e7af80-6519-4477-a131-c5a8df536b7b tempest-VolumesGetTest-150381411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:54:54 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-15e7af80-6519-4477-a131-c5a8df536b7b tempest-VolumesGetTest-150381411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:54:54 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-15e7af80-6519-4477-a131-c5a8df536b7b tempest-VolumesGetTest-150381411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:54:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-15e7af80-6519-4477-a131-c5a8df536b7b tempest-VolumesGetTest-150381411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:54:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-15e7af80-6519-4477-a131-c5a8df536b7b tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:54 devstack sudo[100703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:54:54 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:54 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4d697e31-e304-4172-a5c4-e729c5b9a2cb tempest-VolumesGetTest-150381411 None] Acquiring lock "cinder-559ec4c4-a529-4edb-a56b-2a239af5528c-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:54:54 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bece030b-67e3-4ef9-b615-40c57f31b5c7 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7.b9b5f3a3-12d3-4b84-88fb-3a8c46f7d110" returned: 0 in 0.369s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:55 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7.b9b5f3a3-12d3-4b84-88fb-3a8c46f7d110 is being set with open permissions: ugo+rw Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7.b9b5f3a3-12d3-4b84-88fb-3a8c46f7d110 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4d697e31-e304-4172-a5c4-e729c5b9a2cb tempest-VolumesGetTest-150381411 None] Lock "cinder-559ec4c4-a529-4edb-a56b-2a239af5528c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:54:55 devstack sudo[100708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7.b9b5f3a3-12d3-4b84-88fb-3a8c46f7d110 Sep 10 19:54:55 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4d697e31-e304-4172-a5c4-e729c5b9a2cb tempest-VolumesGetTest-150381411 None] Acquiring lock "cinder-quobyte-559ec4c4-a529-4edb-a56b-2a239af5528c" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4d697e31-e304-4172-a5c4-e729c5b9a2cb tempest-VolumesGetTest-150381411 None] Lock "cinder-quobyte-559ec4c4-a529-4edb-a56b-2a239af5528c" acquired by "delete_volume" :: waited 0.016s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:54:55 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-15e7af80-6519-4477-a131-c5a8df536b7b tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.334s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-15e7af80-6519-4477-a131-c5a8df536b7b tempest-VolumesGetTest-150381411 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:54:55 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-15e7af80-6519-4477-a131-c5a8df536b7b tempest-VolumesGetTest-150381411 None] Deleted volume successfully. Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0a0898-3e5b-4a4a-a3cc-02e4e9d36a2c]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4d697e31-e304-4172-a5c4-e729c5b9a2cb tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-559ec4c4-a529-4edb-a56b-2a239af5528c {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-15e7af80-6519-4477-a131-c5a8df536b7b tempest-VolumesGetTest-150381411 None] Lock "cinder-dcccefdd-c214-4c4c-9ecf-116a6d82b9d8-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:54:55 devstack sudo[100711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-559ec4c4-a529-4edb-a56b-2a239af5528c Sep 10 19:54:55 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:55 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7.b9b5f3a3-12d3-4b84-88fb-3a8c46f7d110" returned: 0 in 0.301s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:55 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7.info Sep 10 19:54:55 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:55 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4d697e31-e304-4172-a5c4-e729c5b9a2cb tempest-VolumesGetTest-150381411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-559ec4c4-a529-4edb-a56b-2a239af5528c" returned: 0 in 0.391s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4d697e31-e304-4172-a5c4-e729c5b9a2cb tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-559ec4c4-a529-4edb-a56b-2a239af5528c {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:55 devstack sudo[100719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-559ec4c4-a529-4edb-a56b-2a239af5528c Sep 10 19:54:55 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:55 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7.info" returned: 0 in 0.266s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:55 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7.info is being set with open permissions: ugo+rw Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:55 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7.info Sep 10 19:54:55 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:55 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4d697e31-e304-4172-a5c4-e729c5b9a2cb tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-559ec4c4-a529-4edb-a56b-2a239af5528c" returned: 0 in 0.264s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4d697e31-e304-4172-a5c4-e729c5b9a2cb tempest-VolumesGetTest-150381411 None] Lock "cinder-quobyte-559ec4c4-a529-4edb-a56b-2a239af5528c" released by "delete_volume" :: held 0.709s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-4d697e31-e304-4172-a5c4-e729c5b9a2cb tempest-VolumesGetTest-150381411 None] Created reservations ['66942d36-c4e7-4431-b9a0-f4ba49fd8292', '01e4b851-3c96-450b-b285-1f533da29f7b', 'a6486582-7483-48dd-b7c7-2f52b9862278', '761cfda1-0e95-4abb-b3a9-d1bdd7f6cdf0'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:54:55 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7.info" returned: 0 in 0.291s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Acquiring lock "cinder-quobyte-747bf1c3-553e-4260-b9d9-7bd6bad506fb" by "_copy_volume_from_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Lock "cinder-quobyte-747bf1c3-553e-4260-b9d9-7bd6bad506fb" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] snapshot: b9b5f3a3-12d3-4b84-88fb-3a8c46f7d110, volume: 747bf1c3-553e-4260-b9d9-7bd6bad506fb, {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[324930dc-0574-43cb-bf45-db1eb7f011c0]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7.b9b5f3a3-12d3-4b84-88fb-3a8c46f7d110 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-4d697e31-e304-4172-a5c4-e729c5b9a2cb tempest-VolumesGetTest-150381411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-4d697e31-e304-4172-a5c4-e729c5b9a2cb tempest-VolumesGetTest-150381411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-4d697e31-e304-4172-a5c4-e729c5b9a2cb tempest-VolumesGetTest-150381411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-4d697e31-e304-4172-a5c4-e729c5b9a2cb tempest-VolumesGetTest-150381411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-4d697e31-e304-4172-a5c4-e729c5b9a2cb tempest-VolumesGetTest-150381411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:54:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4d697e31-e304-4172-a5c4-e729c5b9a2cb tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:56 devstack sudo[100727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:54:56 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:56 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7.b9b5f3a3-12d3-4b84-88fb-3a8c46f7d110 Sep 10 19:54:56 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:56 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b9f457b9-b18c-4f93-ade2-af71e4e8fd3f tempest-VolumesGetTest-150381411 None] Acquiring lock "cinder-bd47223a-3794-479e-91d3-b27c2e7c61e4-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:54:56 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b9f457b9-b18c-4f93-ade2-af71e4e8fd3f tempest-VolumesGetTest-150381411 None] Lock "cinder-bd47223a-3794-479e-91d3-b27c2e7c61e4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:54:56 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4d697e31-e304-4172-a5c4-e729c5b9a2cb tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.279s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:56 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-4d697e31-e304-4172-a5c4-e729c5b9a2cb tempest-VolumesGetTest-150381411 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:54:56 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-4d697e31-e304-4172-a5c4-e729c5b9a2cb tempest-VolumesGetTest-150381411 None] Deleted volume successfully. Sep 10 19:54:56 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4d697e31-e304-4172-a5c4-e729c5b9a2cb tempest-VolumesGetTest-150381411 None] Lock "cinder-559ec4c4-a529-4edb-a56b-2a239af5528c-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:54:56 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b9f457b9-b18c-4f93-ade2-af71e4e8fd3f tempest-VolumesGetTest-150381411 None] Acquiring lock "cinder-quobyte-bd47223a-3794-479e-91d3-b27c2e7c61e4" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:54:56 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b9f457b9-b18c-4f93-ade2-af71e4e8fd3f tempest-VolumesGetTest-150381411 None] Lock "cinder-quobyte-bd47223a-3794-479e-91d3-b27c2e7c61e4" acquired by "delete_volume" :: waited 0.015s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:54:56 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e375be2-4936-4133-a729-3212b7492625]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:54:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b9f457b9-b18c-4f93-ade2-af71e4e8fd3f tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:56 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7.b9b5f3a3-12d3-4b84-88fb-3a8c46f7d110" returned: 0 in 0.422s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bece030b-67e3-4ef9-b615-40c57f31b5c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:54:56 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbcbe46-efb8-46a0-8a5e-50ef2c4753e6]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:54:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:56 devstack sudo[100735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4 Sep 10 19:54:56 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:56 devstack sudo[100736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7 Sep 10 19:54:56 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:56 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b9f457b9-b18c-4f93-ade2-af71e4e8fd3f tempest-VolumesGetTest-150381411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4" returned: 0 in 0.382s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b9f457b9-b18c-4f93-ade2-af71e4e8fd3f tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:56 devstack sudo[100745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4 Sep 10 19:54:56 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:56 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7" returned: 0 in 0.383s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7 {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 19:54:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Creating direct copy from snapshot {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 19:54:56 devstack cinder-volume[88093]: DEBUG cinder.utils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Path /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-747bf1c3-553e-4260-b9d9-7bd6bad506fb not found in is_blk_device check {{(pid=88093) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 19:54:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-747bf1c3-553e-4260-b9d9-7bd6bad506fb {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:56 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-747bf1c3-553e-4260-b9d9-7bd6bad506fb Sep 10 19:54:56 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:57 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b9f457b9-b18c-4f93-ade2-af71e4e8fd3f tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bd47223a-3794-479e-91d3-b27c2e7c61e4" returned: 0 in 0.273s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:57 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b9f457b9-b18c-4f93-ade2-af71e4e8fd3f tempest-VolumesGetTest-150381411 None] Lock "cinder-quobyte-bd47223a-3794-479e-91d3-b27c2e7c61e4" released by "delete_volume" :: held 0.717s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:54:57 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-b9f457b9-b18c-4f93-ade2-af71e4e8fd3f tempest-VolumesGetTest-150381411 None] Created reservations ['335feddd-d85b-4f5b-9d0b-7a124c420ef7', '07aad07f-2a88-4239-be8d-a8a9d0cf5342', '427f18af-e3c3-41cf-a8df-ae8f2fc55133', '54ca19d1-27fc-44f7-af8b-3d1a9e7414bd'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:54:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b9f457b9-b18c-4f93-ade2-af71e4e8fd3f tempest-VolumesGetTest-150381411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:54:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b9f457b9-b18c-4f93-ade2-af71e4e8fd3f tempest-VolumesGetTest-150381411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:54:57 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b9f457b9-b18c-4f93-ade2-af71e4e8fd3f tempest-VolumesGetTest-150381411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:54:57 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b9f457b9-b18c-4f93-ade2-af71e4e8fd3f tempest-VolumesGetTest-150381411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:54:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b9f457b9-b18c-4f93-ade2-af71e4e8fd3f tempest-VolumesGetTest-150381411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:54:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b9f457b9-b18c-4f93-ade2-af71e4e8fd3f tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:54:57 devstack sudo[100754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:54:57 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:54:57 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root Sep 10 19:54:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b9f457b9-b18c-4f93-ade2-af71e4e8fd3f tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.564s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:54:57 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-b9f457b9-b18c-4f93-ade2-af71e4e8fd3f tempest-VolumesGetTest-150381411 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:54:57 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-b9f457b9-b18c-4f93-ade2-af71e4e8fd3f tempest-VolumesGetTest-150381411 None] Deleted volume successfully. Sep 10 19:54:57 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b9f457b9-b18c-4f93-ade2-af71e4e8fd3f tempest-VolumesGetTest-150381411 None] Lock "cinder-bd47223a-3794-479e-91d3-b27c2e7c61e4-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:54:59 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:54:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Flow 'volume_create_manager' (3f5a5a11-019a-47fd-b6bd-beba649f78e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:54:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (648e59c3-5216-4c36-9efb-a1da6c2bc87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (648e59c3-5216-4c36-9efb-a1da6c2bc87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1868365348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c1b601e-0178-464a-9b52-aa5c55494e36,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='68c39f3c07c94daf9bd50b0b6cbdb78b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:54:59Z,use_quota=True,user_id='1d61e9c0d15b4d7896d2ad1b9c988e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038767cf-08c8-47b4-9fc3-5c2d1d26313d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038767cf-08c8-47b4-9fc3-5c2d1d26313d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:54:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8750f4ef-dd57-42ca-9ece-40c291877729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:54:59 devstack cinder-volume[88093]: DEBUG cinder.image.glance [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Creating Keystone auth plugin from conf {{(pid=88093) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 19:55:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8750f4ef-dd57-42ca-9ece-40c291877729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8c1b601e-0178-464a-9b52-aa5c55494e36', 'volume_name': 'volume-8c1b601e-0178-464a-9b52-aa5c55494e36', 'volume_size': 1, 'image_id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cce253731714c6797a2e9bce91009cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'created_at': datetime.datetime(2026, 9, 10, 17, 35, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 35, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2a23b86-b92b-4676-9ae1-992ece6018f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2a23b86-b92b-4676-9ae1-992ece6018f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac38865c-436d-4bf1-8eea-e99cd17fb835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:00 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Volume 8c1b601e-0178-464a-9b52-aa5c55494e36: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8c1b601e-0178-464a-9b52-aa5c55494e36', 'volume_size': 1, 'image_id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cce253731714c6797a2e9bce91009cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'created_at': datetime.datetime(2026, 9, 10, 17, 35, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 35, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 19:55:00 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Trying to clone 8c1b601e-0178-464a-9b52-aa5c55494e36 from image ce7b5bdf-521a-42b1-b62b-e8406ccf342b at location (None, [{'url': 'file:///opt/stack/data/glance/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'metadata': {}}]). {{(pid=88093) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 19:55:01 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_gxdlomchdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88093) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 19:55:01 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Image download 20.69 MB at 20.69 MB/s Sep 10 19:55:01 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ecd53b-4b70-4d8c-8288-9e47d73d32d5]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:55:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_gxdlomchdevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:01 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-747bf1c3-553e-4260-b9d9-7bd6bad506fb" returned: 0 in 4.689s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:01 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Image conversion details: src /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7, size 1024.00 MB, duration 4.69 sec, destination /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-747bf1c3-553e-4260-b9d9-7bd6bad506fb {{(pid=88093) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 19:55:01 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Converted 1024.00 MB image at 218.34 MB/s Sep 10 19:55:01 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-747bf1c3-553e-4260-b9d9-7bd6bad506fb is being set with open permissions: ugo+rw Sep 10 19:55:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-747bf1c3-553e-4260-b9d9-7bd6bad506fb {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:01 devstack sudo[100767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-747bf1c3-553e-4260-b9d9-7bd6bad506fb Sep 10 19:55:01 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:01 devstack sudo[100766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_gxdlomchdevstack@QuobyteHD Sep 10 19:55:01 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:01 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-747bf1c3-553e-4260-b9d9-7bd6bad506fb" returned: 0 in 0.244s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:01 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Lock "cinder-quobyte-747bf1c3-553e-4260-b9d9-7bd6bad506fb" released by "_copy_volume_from_snapshot" :: held 5.825s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:55:01 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_gxdlomchdevstack@QuobyteHD" returned: 0 in 0.319s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:01 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Temporary image ce7b5bdf-521a-42b1-b62b-e8406ccf342b is fetched for user 1d61e9c0d15b4d7896d2ad1b9c988e63. {{(pid=88093) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 19:55:01 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Acquiring lock "cinder-quobyte-b9b5f3a3-12d3-4b84-88fb-3a8c46f7d110" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:55:01 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Lock "cinder-quobyte-b9b5f3a3-12d3-4b84-88fb-3a8c46f7d110" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:55:01 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Deleting offline snapshot b9b5f3a3-12d3-4b84-88fb-3a8c46f7d110 of volume bece030b-67e3-4ef9-b615-40c57f31b5c7 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 19:55:01 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] snapshot_file for this snap is: volume-bece030b-67e3-4ef9-b615-40c57f31b5c7.b9b5f3a3-12d3-4b84-88fb-3a8c46f7d110 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 19:55:01 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8230255-7ee5-43bc-830f-dfc7ec136902]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:55:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7.b9b5f3a3-12d3-4b84-88fb-3a8c46f7d110 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:01 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce66a27f-dc67-447c-a98e-00b3d3dd2474]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:55:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_gxdlomchdevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:01 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7.b9b5f3a3-12d3-4b84-88fb-3a8c46f7d110 Sep 10 19:55:01 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:01 devstack sudo[100778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_gxdlomchdevstack@QuobyteHD Sep 10 19:55:01 devstack sudo[100778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:02 devstack sudo[100778]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_gxdlomchdevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:55:02 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7.b9b5f3a3-12d3-4b84-88fb-3a8c46f7d110" returned: 0 in 0.377s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:02 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bece030b-67e3-4ef9-b615-40c57f31b5c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:55:02 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0b8832-967a-4c5b-8edb-f0b95fe6d163]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:55:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:02 devstack sudo[100787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7 Sep 10 19:55:02 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:02 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7" returned: 0 in 0.482s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7.b9b5f3a3-12d3-4b84-88fb-3a8c46f7d110 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:02 devstack sudo[100792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7.b9b5f3a3-12d3-4b84-88fb-3a8c46f7d110 Sep 10 19:55:02 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:03 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7.b9b5f3a3-12d3-4b84-88fb-3a8c46f7d110" returned: 0 in 0.321s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7.b9b5f3a3-12d3-4b84-88fb-3a8c46f7d110 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:03 devstack sudo[100797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7.b9b5f3a3-12d3-4b84-88fb-3a8c46f7d110 Sep 10 19:55:03 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:03 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7.b9b5f3a3-12d3-4b84-88fb-3a8c46f7d110" returned: 0 in 0.256s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:03 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Lock "cinder-quobyte-b9b5f3a3-12d3-4b84-88fb-3a8c46f7d110" released by "_delete_snapshot" :: held 1.524s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:55:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.744s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:55:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e2e6b45b-8cdb-42de-b4f5-1379be279240 tempest-SnapshotsActionsTest-774626312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.780s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:55:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8730d7-48c3-436a-87f0-0a6fbef5e3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-747bf1c3-553e-4260-b9d9-7bd6bad506fb', 'volume_size': 2, 'source_volid': 'bece030b-67e3-4ef9-b615-40c57f31b5c7', 'source_volstatus': 'available'}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d179557-6a83-4190-a278-1d802a97e141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-e2e6b45b-8cdb-42de-b4f5-1379be279240 tempest-SnapshotsActionsTest-774626312 None] Creating offline snapshot ec83f04b-db78-4e34-9fca-aa3dd65fdc31 of volume 6688cd76-af2a-4524-95ef-fdc2a62867a9 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 19:55:03 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Volume volume-747bf1c3-553e-4260-b9d9-7bd6bad506fb (747bf1c3-553e-4260-b9d9-7bd6bad506fb): created successfully Sep 10 19:55:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d179557-6a83-4190-a278-1d802a97e141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Flow 'volume_create_manager' (6964a978-d1e8-4442-bfdb-17fbeea14045) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:55:03 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[3971012e-260c-4d68-b0c6-c8c0df94234d]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:55:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e2e6b45b-8cdb-42de-b4f5-1379be279240 tempest-SnapshotsActionsTest-774626312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:03 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-32070a6a-575b-41ad-b47a-f4b7bec2b414 tempest-VolumesCloneTest-2098235866 None] Created volume successfully. Sep 10 19:55:03 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab Sep 10 19:55:03 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:03 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e2e6b45b-8cdb-42de-b4f5-1379be279240 tempest-SnapshotsActionsTest-774626312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab" returned: 0 in 0.366s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-e2e6b45b-8cdb-42de-b4f5-1379be279240 tempest-SnapshotsActionsTest-774626312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6688cd76-af2a-4524-95ef-fdc2a62867a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:55:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e2e6b45b-8cdb-42de-b4f5-1379be279240 tempest-SnapshotsActionsTest-774626312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.ec83f04b-db78-4e34-9fca-aa3dd65fdc31 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:03 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.ec83f04b-db78-4e34-9fca-aa3dd65fdc31 1G Sep 10 19:55:03 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:03 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:55:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:55:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:55:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:55:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:55:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:55:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:03 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:55:03 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:04 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.246s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:04 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:55:04 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager._thread_info {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:55:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread count: 28 {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 19:55:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread info: [<_MainThread(MainThread, started 138417491665024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 19:55:04 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e2e6b45b-8cdb-42de-b4f5-1379be279240 tempest-SnapshotsActionsTest-774626312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.ec83f04b-db78-4e34-9fca-aa3dd65fdc31 1G" returned: 0 in 0.425s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e2e6b45b-8cdb-42de-b4f5-1379be279240 tempest-SnapshotsActionsTest-774626312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.ec83f04b-db78-4e34-9fca-aa3dd65fdc31 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:04 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.ec83f04b-db78-4e34-9fca-aa3dd65fdc31 Sep 10 19:55:04 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:04 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e2e6b45b-8cdb-42de-b4f5-1379be279240 tempest-SnapshotsActionsTest-774626312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.ec83f04b-db78-4e34-9fca-aa3dd65fdc31" returned: 0 in 0.311s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:04 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-e2e6b45b-8cdb-42de-b4f5-1379be279240 tempest-SnapshotsActionsTest-774626312 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.ec83f04b-db78-4e34-9fca-aa3dd65fdc31 is being set with open permissions: ugo+rw Sep 10 19:55:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e2e6b45b-8cdb-42de-b4f5-1379be279240 tempest-SnapshotsActionsTest-774626312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.ec83f04b-db78-4e34-9fca-aa3dd65fdc31 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:04 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.ec83f04b-db78-4e34-9fca-aa3dd65fdc31 Sep 10 19:55:04 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:04 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-73f766c8-7bfe-4fff-90fd-515d6deffc33 tempest-VolumesCloneTest-2098235866 None] Acquiring lock "cinder-747bf1c3-553e-4260-b9d9-7bd6bad506fb-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:55:04 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-73f766c8-7bfe-4fff-90fd-515d6deffc33 tempest-VolumesCloneTest-2098235866 None] Lock "cinder-747bf1c3-553e-4260-b9d9-7bd6bad506fb-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:55:04 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-73f766c8-7bfe-4fff-90fd-515d6deffc33 tempest-VolumesCloneTest-2098235866 None] Acquiring lock "cinder-quobyte-747bf1c3-553e-4260-b9d9-7bd6bad506fb" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:55:04 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-73f766c8-7bfe-4fff-90fd-515d6deffc33 tempest-VolumesCloneTest-2098235866 None] Lock "cinder-quobyte-747bf1c3-553e-4260-b9d9-7bd6bad506fb" acquired by "delete_volume" :: waited 0.023s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:55:04 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f4b929-0457-4571-99ce-6d9382a8e253]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:55:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-73f766c8-7bfe-4fff-90fd-515d6deffc33 tempest-VolumesCloneTest-2098235866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-747bf1c3-553e-4260-b9d9-7bd6bad506fb {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:04 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e2e6b45b-8cdb-42de-b4f5-1379be279240 tempest-SnapshotsActionsTest-774626312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.ec83f04b-db78-4e34-9fca-aa3dd65fdc31" returned: 0 in 0.324s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e2e6b45b-8cdb-42de-b4f5-1379be279240 tempest-SnapshotsActionsTest-774626312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.553s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:55:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.750s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:55:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1868365348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c1b601e-0178-464a-9b52-aa5c55494e36,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='68c39f3c07c94daf9bd50b0b6cbdb78b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:54:59Z,use_quota=True,user_id='1d61e9c0d15b4d7896d2ad1b9c988e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:55:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Creating volume 8c1b601e-0178-464a-9b52-aa5c55494e36 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:55:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:55:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:55:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:55:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:55:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:55:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:55:04 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:55:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8c1b601e-0178-464a-9b52-aa5c55494e36 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:04 devstack sudo[100820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-747bf1c3-553e-4260-b9d9-7bd6bad506fb Sep 10 19:55:04 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:04 devstack sudo[100823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8c1b601e-0178-464a-9b52-aa5c55494e36 1073741824 Sep 10 19:55:04 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:05 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-e2e6b45b-8cdb-42de-b4f5-1379be279240 tempest-SnapshotsActionsTest-774626312 None] Create snapshot completed successfully Sep 10 19:55:05 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-73f766c8-7bfe-4fff-90fd-515d6deffc33 tempest-VolumesCloneTest-2098235866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-747bf1c3-553e-4260-b9d9-7bd6bad506fb" returned: 0 in 0.445s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-73f766c8-7bfe-4fff-90fd-515d6deffc33 tempest-VolumesCloneTest-2098235866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-747bf1c3-553e-4260-b9d9-7bd6bad506fb {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:05 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-747bf1c3-553e-4260-b9d9-7bd6bad506fb Sep 10 19:55:05 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:05 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:05 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3d0137ab-dee0-4713-bdcd-24270303d5af tempest-SnapshotsActionsTest-565968155 None] Acquiring lock "cinder-ec83f04b-db78-4e34-9fca-aa3dd65fdc31-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:55:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8c1b601e-0178-464a-9b52-aa5c55494e36 1073741824" returned: 0 in 0.543s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:05 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3d0137ab-dee0-4713-bdcd-24270303d5af tempest-SnapshotsActionsTest-565968155 None] Lock "cinder-ec83f04b-db78-4e34-9fca-aa3dd65fdc31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:55:05 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3d0137ab-dee0-4713-bdcd-24270303d5af tempest-SnapshotsActionsTest-565968155 None] Acquiring lock "cinder-quobyte-6688cd76-af2a-4524-95ef-fdc2a62867a9" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:55:05 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3d0137ab-dee0-4713-bdcd-24270303d5af tempest-SnapshotsActionsTest-565968155 None] Lock "cinder-quobyte-6688cd76-af2a-4524-95ef-fdc2a62867a9" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:55:05 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3d0137ab-dee0-4713-bdcd-24270303d5af tempest-SnapshotsActionsTest-565968155 None] Acquiring lock "cinder-quobyte-ec83f04b-db78-4e34-9fca-aa3dd65fdc31" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:55:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8c1b601e-0178-464a-9b52-aa5c55494e36 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:05 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3d0137ab-dee0-4713-bdcd-24270303d5af tempest-SnapshotsActionsTest-565968155 None] Lock "cinder-quobyte-ec83f04b-db78-4e34-9fca-aa3dd65fdc31" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:55:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-3d0137ab-dee0-4713-bdcd-24270303d5af tempest-SnapshotsActionsTest-565968155 None] Deleting offline snapshot ec83f04b-db78-4e34-9fca-aa3dd65fdc31 of volume 6688cd76-af2a-4524-95ef-fdc2a62867a9 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 19:55:05 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8c1b601e-0178-464a-9b52-aa5c55494e36 Sep 10 19:55:05 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-3d0137ab-dee0-4713-bdcd-24270303d5af tempest-SnapshotsActionsTest-565968155 None] snapshot_file for this snap is: volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.ec83f04b-db78-4e34-9fca-aa3dd65fdc31 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 19:55:05 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aec1718-25a5-4981-9bfa-ffa482e4ac3d]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:55:05 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3d0137ab-dee0-4713-bdcd-24270303d5af tempest-SnapshotsActionsTest-565968155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.ec83f04b-db78-4e34-9fca-aa3dd65fdc31 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-73f766c8-7bfe-4fff-90fd-515d6deffc33 tempest-VolumesCloneTest-2098235866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-747bf1c3-553e-4260-b9d9-7bd6bad506fb" returned: 0 in 0.351s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:05 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-73f766c8-7bfe-4fff-90fd-515d6deffc33 tempest-VolumesCloneTest-2098235866 None] Lock "cinder-quobyte-747bf1c3-553e-4260-b9d9-7bd6bad506fb" released by "delete_volume" :: held 0.839s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:55:05 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-73f766c8-7bfe-4fff-90fd-515d6deffc33 tempest-VolumesCloneTest-2098235866 None] Created reservations ['743d4219-5fbb-492e-845e-5b0b7b2453b3', '10b5ab90-aabb-4259-b418-d341febbe76e', 'e55c6dcb-374c-461a-ba6f-7df55eb730ca', '69108168-1d95-4b21-9968-e51ac045f1d8'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:55:05 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.ec83f04b-db78-4e34-9fca-aa3dd65fdc31 Sep 10 19:55:05 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-73f766c8-7bfe-4fff-90fd-515d6deffc33 tempest-VolumesCloneTest-2098235866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:55:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-73f766c8-7bfe-4fff-90fd-515d6deffc33 tempest-VolumesCloneTest-2098235866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:55:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-73f766c8-7bfe-4fff-90fd-515d6deffc33 tempest-VolumesCloneTest-2098235866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:55:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-73f766c8-7bfe-4fff-90fd-515d6deffc33 tempest-VolumesCloneTest-2098235866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:55:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-73f766c8-7bfe-4fff-90fd-515d6deffc33 tempest-VolumesCloneTest-2098235866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:55:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-73f766c8-7bfe-4fff-90fd-515d6deffc33 tempest-VolumesCloneTest-2098235866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:05 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:55:05 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:05 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8c1b601e-0178-464a-9b52-aa5c55494e36" returned: 0 in 0.353s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:55:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:55:05 devstack cinder-volume[88093]: DEBUG cinder.volume.volume_utils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Attempting download of ce7b5bdf-521a-42b1-b62b-e8406ccf342b ((None, [{'url': 'file:///opt/stack/data/glance/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'metadata': {}}])) to volume 8c1b601e-0178-464a-9b52-aa5c55494e36. {{(pid=88093) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 19:55:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-45b33b59-f3f5-4630-88e3-14c3ef3be910 tempest-VolumesCloneTest-2098235866 None] Acquiring lock "cinder-bece030b-67e3-4ef9-b615-40c57f31b5c7-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:55:06 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e5aa1e-9c25-4f50-b85f-ea23fb22cff3]: (4, 'raw') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:55:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_xp7ogxse {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-45b33b59-f3f5-4630-88e3-14c3ef3be910 tempest-VolumesCloneTest-2098235866 None] Lock "cinder-bece030b-67e3-4ef9-b615-40c57f31b5c7-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:55:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-45b33b59-f3f5-4630-88e3-14c3ef3be910 tempest-VolumesCloneTest-2098235866 None] Acquiring lock "cinder-quobyte-bece030b-67e3-4ef9-b615-40c57f31b5c7" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:55:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-45b33b59-f3f5-4630-88e3-14c3ef3be910 tempest-VolumesCloneTest-2098235866 None] Lock "cinder-quobyte-bece030b-67e3-4ef9-b615-40c57f31b5c7" acquired by "delete_volume" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:55:06 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3d0137ab-dee0-4713-bdcd-24270303d5af tempest-SnapshotsActionsTest-565968155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.ec83f04b-db78-4e34-9fca-aa3dd65fdc31" returned: 0 in 0.558s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:06 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-3d0137ab-dee0-4713-bdcd-24270303d5af tempest-SnapshotsActionsTest-565968155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6688cd76-af2a-4524-95ef-fdc2a62867a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:55:06 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:06 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[08aace08-a57d-4444-9a25-163d84d227e8]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:55:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-45b33b59-f3f5-4630-88e3-14c3ef3be910 tempest-VolumesCloneTest-2098235866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:06 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e115d6b-21d8-4d92-a214-4a4f2ee9a07b]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:55:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3d0137ab-dee0-4713-bdcd-24270303d5af tempest-SnapshotsActionsTest-565968155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:06 devstack sudo[100844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_xp7ogxse Sep 10 19:55:06 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-73f766c8-7bfe-4fff-90fd-515d6deffc33 tempest-VolumesCloneTest-2098235866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.389s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:06 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-73f766c8-7bfe-4fff-90fd-515d6deffc33 tempest-VolumesCloneTest-2098235866 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:55:06 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-73f766c8-7bfe-4fff-90fd-515d6deffc33 tempest-VolumesCloneTest-2098235866 None] Deleted volume successfully. Sep 10 19:55:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-73f766c8-7bfe-4fff-90fd-515d6deffc33 tempest-VolumesCloneTest-2098235866 None] Lock "cinder-747bf1c3-553e-4260-b9d9-7bd6bad506fb-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:55:06 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7 Sep 10 19:55:06 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:06 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab Sep 10 19:55:06 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:06 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_xp7ogxse" returned: 0 in 0.383s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_xp7ogxse {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:06 devstack sudo[100854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_xp7ogxse Sep 10 19:55:06 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:06 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-45b33b59-f3f5-4630-88e3-14c3ef3be910 tempest-VolumesCloneTest-2098235866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7" returned: 0 in 0.400s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-45b33b59-f3f5-4630-88e3-14c3ef3be910 tempest-VolumesCloneTest-2098235866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:06 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:06 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7 Sep 10 19:55:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3d0137ab-dee0-4713-bdcd-24270303d5af tempest-SnapshotsActionsTest-565968155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab" returned: 0 in 0.412s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:06 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-3d0137ab-dee0-4713-bdcd-24270303d5af tempest-SnapshotsActionsTest-565968155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6688cd76-af2a-4524-95ef-fdc2a62867a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:55:06 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3d0137ab-dee0-4713-bdcd-24270303d5af tempest-SnapshotsActionsTest-565968155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.ec83f04b-db78-4e34-9fca-aa3dd65fdc31 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:06 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.ec83f04b-db78-4e34-9fca-aa3dd65fdc31 Sep 10 19:55:06 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:06 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_xp7ogxse" returned: 1 in 0.367s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_xp7ogxse' failed. Not Retrying. {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 19:55:06 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[89324620-8bd2-4e46-b361-762684f95bc7]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:55:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_gxdlomchdevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:06 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-45b33b59-f3f5-4630-88e3-14c3ef3be910 tempest-VolumesCloneTest-2098235866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bece030b-67e3-4ef9-b615-40c57f31b5c7" returned: 0 in 0.264s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-45b33b59-f3f5-4630-88e3-14c3ef3be910 tempest-VolumesCloneTest-2098235866 None] Lock "cinder-quobyte-bece030b-67e3-4ef9-b615-40c57f31b5c7" released by "delete_volume" :: held 0.745s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:55:06 devstack sudo[100870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_gxdlomchdevstack@QuobyteHD Sep 10 19:55:06 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:06 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-45b33b59-f3f5-4630-88e3-14c3ef3be910 tempest-VolumesCloneTest-2098235866 None] Created reservations ['7b968faf-12c4-43d9-9c21-2b745fc188c8', 'afd83eb0-325e-4de9-9677-2246bfad4373', '80a8ca99-bc15-4d4b-8b5f-d812d552e826', '3abe9758-f238-42b9-a4a0-7f3daef573b6'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:55:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-45b33b59-f3f5-4630-88e3-14c3ef3be910 tempest-VolumesCloneTest-2098235866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:55:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-45b33b59-f3f5-4630-88e3-14c3ef3be910 tempest-VolumesCloneTest-2098235866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:55:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-45b33b59-f3f5-4630-88e3-14c3ef3be910 tempest-VolumesCloneTest-2098235866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:55:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-45b33b59-f3f5-4630-88e3-14c3ef3be910 tempest-VolumesCloneTest-2098235866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:55:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-45b33b59-f3f5-4630-88e3-14c3ef3be910 tempest-VolumesCloneTest-2098235866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:55:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-45b33b59-f3f5-4630-88e3-14c3ef3be910 tempest-VolumesCloneTest-2098235866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:07 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3d0137ab-dee0-4713-bdcd-24270303d5af tempest-SnapshotsActionsTest-565968155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.ec83f04b-db78-4e34-9fca-aa3dd65fdc31" returned: 0 in 0.435s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3d0137ab-dee0-4713-bdcd-24270303d5af tempest-SnapshotsActionsTest-565968155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.ec83f04b-db78-4e34-9fca-aa3dd65fdc31 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:07 devstack sudo[100876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:55:07 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:07 devstack sudo[100878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.ec83f04b-db78-4e34-9fca-aa3dd65fdc31 Sep 10 19:55:07 devstack sudo[100878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:07 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_gxdlomchdevstack@QuobyteHD" returned: 0 in 0.431s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:07 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] ce7b5bdf-521a-42b1-b62b-e8406ccf342b was qcow2, converting to qcow2 {{(pid=88093) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 19:55:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_gxdlomchdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8c1b601e-0178-464a-9b52-aa5c55494e36 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:07 devstack sudo[100884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_gxdlomchdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8c1b601e-0178-464a-9b52-aa5c55494e36 Sep 10 19:55:07 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:07 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-45b33b59-f3f5-4630-88e3-14c3ef3be910 tempest-VolumesCloneTest-2098235866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.278s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:07 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-45b33b59-f3f5-4630-88e3-14c3ef3be910 tempest-VolumesCloneTest-2098235866 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:55:07 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-45b33b59-f3f5-4630-88e3-14c3ef3be910 tempest-VolumesCloneTest-2098235866 None] Deleted volume successfully. Sep 10 19:55:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-45b33b59-f3f5-4630-88e3-14c3ef3be910 tempest-VolumesCloneTest-2098235866 None] Lock "cinder-bece030b-67e3-4ef9-b615-40c57f31b5c7-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:55:07 devstack sudo[100878]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3d0137ab-dee0-4713-bdcd-24270303d5af tempest-SnapshotsActionsTest-565968155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.ec83f04b-db78-4e34-9fca-aa3dd65fdc31" returned: 0 in 0.330s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3d0137ab-dee0-4713-bdcd-24270303d5af tempest-SnapshotsActionsTest-565968155 None] Lock "cinder-quobyte-ec83f04b-db78-4e34-9fca-aa3dd65fdc31" released by "_delete_snapshot" :: held 1.839s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:55:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3d0137ab-dee0-4713-bdcd-24270303d5af tempest-SnapshotsActionsTest-565968155 None] Lock "cinder-quobyte-6688cd76-af2a-4524-95ef-fdc2a62867a9" released by "delete_snapshot" :: held 1.879s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:55:07 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-3d0137ab-dee0-4713-bdcd-24270303d5af tempest-SnapshotsActionsTest-565968155 None] Created reservations ['c6c7d419-cf30-4960-9d5a-b40e334edcd4', '37ba2114-e817-444a-9a9b-f9c8a69a66fd', '83b115f2-5ef6-4f0f-909e-4808143f085b', 'be65b779-c4c7-4eb8-a05d-dba3896fc5d0'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:55:07 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-3d0137ab-dee0-4713-bdcd-24270303d5af tempest-SnapshotsActionsTest-565968155 None] Delete snapshot completed successfully. Sep 10 19:55:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3d0137ab-dee0-4713-bdcd-24270303d5af tempest-SnapshotsActionsTest-565968155 None] Lock "cinder-ec83f04b-db78-4e34-9fca-aa3dd65fdc31-delete_snapshot" released by "delete_snapshot" :: held 2.063s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:55:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-535f5d70-a705-4dcd-b9ec-7422c48a93bc tempest-SnapshotsActionsTest-774626312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:55:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-535f5d70-a705-4dcd-b9ec-7422c48a93bc tempest-SnapshotsActionsTest-774626312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:55:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-535f5d70-a705-4dcd-b9ec-7422c48a93bc tempest-SnapshotsActionsTest-774626312 None] Creating offline snapshot 07bb52e1-690e-4b62-8274-792ca41fafe9 of volume 6688cd76-af2a-4524-95ef-fdc2a62867a9 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 19:55:08 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e21029-306b-49b9-ab6a-d3b5fdc603cb]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:55:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-535f5d70-a705-4dcd-b9ec-7422c48a93bc tempest-SnapshotsActionsTest-774626312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:08 devstack sudo[100896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab Sep 10 19:55:08 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:08 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-535f5d70-a705-4dcd-b9ec-7422c48a93bc tempest-SnapshotsActionsTest-774626312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab" returned: 0 in 0.461s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-535f5d70-a705-4dcd-b9ec-7422c48a93bc tempest-SnapshotsActionsTest-774626312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6688cd76-af2a-4524-95ef-fdc2a62867a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:55:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-535f5d70-a705-4dcd-b9ec-7422c48a93bc tempest-SnapshotsActionsTest-774626312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.07bb52e1-690e-4b62-8274-792ca41fafe9 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:08 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.07bb52e1-690e-4b62-8274-792ca41fafe9 1G Sep 10 19:55:08 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:09 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-535f5d70-a705-4dcd-b9ec-7422c48a93bc tempest-SnapshotsActionsTest-774626312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.07bb52e1-690e-4b62-8274-792ca41fafe9 1G" returned: 0 in 0.587s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-535f5d70-a705-4dcd-b9ec-7422c48a93bc tempest-SnapshotsActionsTest-774626312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.07bb52e1-690e-4b62-8274-792ca41fafe9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:09 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.07bb52e1-690e-4b62-8274-792ca41fafe9 Sep 10 19:55:09 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:09 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_gxdlomchdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8c1b601e-0178-464a-9b52-aa5c55494e36" returned: 0 in 2.189s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:09 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_gxdlomchdevstack@QuobyteHD, size 112.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8c1b601e-0178-464a-9b52-aa5c55494e36 {{(pid=88093) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 19:55:09 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Converted 112.00 MB image at 51.11 MB/s Sep 10 19:55:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8c1b601e-0178-464a-9b52-aa5c55494e36 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:09 devstack sudo[100909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8c1b601e-0178-464a-9b52-aa5c55494e36 1G Sep 10 19:55:09 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:09 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-535f5d70-a705-4dcd-b9ec-7422c48a93bc tempest-SnapshotsActionsTest-774626312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.07bb52e1-690e-4b62-8274-792ca41fafe9" returned: 0 in 0.321s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:09 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-535f5d70-a705-4dcd-b9ec-7422c48a93bc tempest-SnapshotsActionsTest-774626312 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.07bb52e1-690e-4b62-8274-792ca41fafe9 is being set with open permissions: ugo+rw Sep 10 19:55:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-535f5d70-a705-4dcd-b9ec-7422c48a93bc tempest-SnapshotsActionsTest-774626312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.07bb52e1-690e-4b62-8274-792ca41fafe9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:09 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.07bb52e1-690e-4b62-8274-792ca41fafe9 Sep 10 19:55:09 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:09 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-535f5d70-a705-4dcd-b9ec-7422c48a93bc tempest-SnapshotsActionsTest-774626312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.07bb52e1-690e-4b62-8274-792ca41fafe9" returned: 0 in 0.259s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:09 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8c1b601e-0178-464a-9b52-aa5c55494e36 1G" returned: 0 in 0.382s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:09 devstack cinder-volume[88093]: DEBUG cinder.volume.volume_utils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Downloaded image ce7b5bdf-521a-42b1-b62b-e8406ccf342b ((None, [{'url': 'file:///opt/stack/data/glance/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'metadata': {}}])) to volume 8c1b601e-0178-464a-9b52-aa5c55494e36 successfully. {{(pid=88093) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 19:55:09 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Temporary image ce7b5bdf-521a-42b1-b62b-e8406ccf342b for user 1d61e9c0d15b4d7896d2ad1b9c988e63 is deleted. {{(pid=88093) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 19:55:09 devstack cinder-volume[88093]: DEBUG cinder.volume.volume_utils [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Marking volume 8c1b601e-0178-464a-9b52-aa5c55494e36 as bootable. {{(pid=88093) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 19:55:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-535f5d70-a705-4dcd-b9ec-7422c48a93bc tempest-SnapshotsActionsTest-774626312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.766s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:55:09 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Copying metadata from image ce7b5bdf-521a-42b1-b62b-e8406ccf342b to 8c1b601e-0178-464a-9b52-aa5c55494e36. {{(pid=88093) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 19:55:09 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Creating volume glance metadata for volume 8c1b601e-0178-464a-9b52-aa5c55494e36 backed by image ce7b5bdf-521a-42b1-b62b-e8406ccf342b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88093) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 19:55:09 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-535f5d70-a705-4dcd-b9ec-7422c48a93bc tempest-SnapshotsActionsTest-774626312 None] Create snapshot completed successfully Sep 10 19:55:09 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac38865c-436d-4bf1-8eea-e99cd17fb835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c1b601e-0178-464a-9b52-aa5c55494e36', 'volume_size': 1, 'image_id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cce253731714c6797a2e9bce91009cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'created_at': datetime.datetime(2026, 9, 10, 17, 35, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 35, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:09 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3574b8a-8334-467f-8bcd-cc7c0bdd7d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:09 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Volume volume-8c1b601e-0178-464a-9b52-aa5c55494e36 (8c1b601e-0178-464a-9b52-aa5c55494e36): created successfully Sep 10 19:55:09 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3574b8a-8334-467f-8bcd-cc7c0bdd7d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:09 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Flow 'volume_create_manager' (3f5a5a11-019a-47fd-b6bd-beba649f78e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:55:10 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-08ee0e40-a39b-4063-8258-05d9ed14cec9 tempest-VolumesGetTest-150381411 None] Created volume successfully. Sep 10 19:55:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1138d706-9ea4-406c-97e9-b1b72f91a2a4 tempest-SnapshotsActionsTest-565968155 None] Acquiring lock "cinder-07bb52e1-690e-4b62-8274-792ca41fafe9-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:55:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1138d706-9ea4-406c-97e9-b1b72f91a2a4 tempest-SnapshotsActionsTest-565968155 None] Lock "cinder-07bb52e1-690e-4b62-8274-792ca41fafe9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:55:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1138d706-9ea4-406c-97e9-b1b72f91a2a4 tempest-SnapshotsActionsTest-565968155 None] Acquiring lock "cinder-quobyte-6688cd76-af2a-4524-95ef-fdc2a62867a9" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:55:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1138d706-9ea4-406c-97e9-b1b72f91a2a4 tempest-SnapshotsActionsTest-565968155 None] Lock "cinder-quobyte-6688cd76-af2a-4524-95ef-fdc2a62867a9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:55:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1138d706-9ea4-406c-97e9-b1b72f91a2a4 tempest-SnapshotsActionsTest-565968155 None] Acquiring lock "cinder-quobyte-07bb52e1-690e-4b62-8274-792ca41fafe9" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:55:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1138d706-9ea4-406c-97e9-b1b72f91a2a4 tempest-SnapshotsActionsTest-565968155 None] Lock "cinder-quobyte-07bb52e1-690e-4b62-8274-792ca41fafe9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:55:10 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-1138d706-9ea4-406c-97e9-b1b72f91a2a4 tempest-SnapshotsActionsTest-565968155 None] Deleting offline snapshot 07bb52e1-690e-4b62-8274-792ca41fafe9 of volume 6688cd76-af2a-4524-95ef-fdc2a62867a9 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 19:55:10 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-1138d706-9ea4-406c-97e9-b1b72f91a2a4 tempest-SnapshotsActionsTest-565968155 None] snapshot_file for this snap is: volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.07bb52e1-690e-4b62-8274-792ca41fafe9 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 19:55:10 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67d9676-5fc7-4c2d-82cf-50445ad512ed]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:55:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1138d706-9ea4-406c-97e9-b1b72f91a2a4 tempest-SnapshotsActionsTest-565968155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.07bb52e1-690e-4b62-8274-792ca41fafe9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:10 devstack sudo[100921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.07bb52e1-690e-4b62-8274-792ca41fafe9 Sep 10 19:55:10 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:10 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1138d706-9ea4-406c-97e9-b1b72f91a2a4 tempest-SnapshotsActionsTest-565968155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.07bb52e1-690e-4b62-8274-792ca41fafe9" returned: 0 in 0.568s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:10 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-1138d706-9ea4-406c-97e9-b1b72f91a2a4 tempest-SnapshotsActionsTest-565968155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6688cd76-af2a-4524-95ef-fdc2a62867a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:55:11 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ecf9a0-f362-4546-8dcd-c44a19dccbc6]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:55:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1138d706-9ea4-406c-97e9-b1b72f91a2a4 tempest-SnapshotsActionsTest-565968155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:11 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:55:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] Flow 'volume_create_manager' (f3aa8e55-997c-49a8-9f16-8907390efa49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:55:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ccccbd-ba6a-4b08-9df8-a35efd277d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:11 devstack sudo[101186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab Sep 10 19:55:11 devstack sudo[101186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ccccbd-ba6a-4b08-9df8-a35efd277d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:55:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-848943099',display_name='tempest-VolumesGetTest-Volume-927426373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e63378d-5c7c-4caf-bdff-dc509ee50b67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c39f3c07c94daf9bd50b0b6cbdb78b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:55:11Z,use_quota=True,user_id='1d61e9c0d15b4d7896d2ad1b9c988e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead0f188-3a5c-4959-a341-8bca97d62dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead0f188-3a5c-4959-a341-8bca97d62dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d4d38f-0e11-4758-927b-107f44673aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d4d38f-0e11-4758-927b-107f44673aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e63378d-5c7c-4caf-bdff-dc509ee50b67', 'volume_name': 'volume-9e63378d-5c7c-4caf-bdff-dc509ee50b67', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f1194c-ccc3-4cc2-adf7-655e5481233c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f1194c-ccc3-4cc2-adf7-655e5481233c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bd56fe-95d2-4f38-bc38-1a8832c493a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:11 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] Volume 9e63378d-5c7c-4caf-bdff-dc509ee50b67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e63378d-5c7c-4caf-bdff-dc509ee50b67', 'volume_size': 1} Sep 10 19:55:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:55:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:55:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:55:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-848943099',display_name='tempest-VolumesGetTest-Volume-927426373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e63378d-5c7c-4caf-bdff-dc509ee50b67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c39f3c07c94daf9bd50b0b6cbdb78b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:55:11Z,use_quota=True,user_id='1d61e9c0d15b4d7896d2ad1b9c988e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:55:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] Creating volume 9e63378d-5c7c-4caf-bdff-dc509ee50b67 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:55:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:55:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:55:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:55:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:55:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:55:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:55:11 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:55:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9e63378d-5c7c-4caf-bdff-dc509ee50b67 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:11 devstack sudo[101294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9e63378d-5c7c-4caf-bdff-dc509ee50b67 1073741824 Sep 10 19:55:11 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:11 devstack sudo[101186]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1138d706-9ea4-406c-97e9-b1b72f91a2a4 tempest-SnapshotsActionsTest-565968155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab" returned: 0 in 0.523s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-1138d706-9ea4-406c-97e9-b1b72f91a2a4 tempest-SnapshotsActionsTest-565968155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6688cd76-af2a-4524-95ef-fdc2a62867a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:55:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1138d706-9ea4-406c-97e9-b1b72f91a2a4 tempest-SnapshotsActionsTest-565968155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.07bb52e1-690e-4b62-8274-792ca41fafe9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:11 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.07bb52e1-690e-4b62-8274-792ca41fafe9 Sep 10 19:55:11 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:11 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9e63378d-5c7c-4caf-bdff-dc509ee50b67 1073741824" returned: 0 in 0.594s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9e63378d-5c7c-4caf-bdff-dc509ee50b67 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:11 devstack sudo[101361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9e63378d-5c7c-4caf-bdff-dc509ee50b67 Sep 10 19:55:11 devstack sudo[101361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:12 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1138d706-9ea4-406c-97e9-b1b72f91a2a4 tempest-SnapshotsActionsTest-565968155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.07bb52e1-690e-4b62-8274-792ca41fafe9" returned: 0 in 0.605s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1138d706-9ea4-406c-97e9-b1b72f91a2a4 tempest-SnapshotsActionsTest-565968155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.07bb52e1-690e-4b62-8274-792ca41fafe9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:12 devstack sudo[101363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.07bb52e1-690e-4b62-8274-792ca41fafe9 Sep 10 19:55:12 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:12 devstack sudo[101361]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9e63378d-5c7c-4caf-bdff-dc509ee50b67" returned: 0 in 0.373s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:12 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:55:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:55:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bd56fe-95d2-4f38-bc38-1a8832c493a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e63378d-5c7c-4caf-bdff-dc509ee50b67', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea06c0a0-201b-4490-b1b1-810ea88d664e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:12 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] Volume volume-9e63378d-5c7c-4caf-bdff-dc509ee50b67 (9e63378d-5c7c-4caf-bdff-dc509ee50b67): created successfully Sep 10 19:55:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea06c0a0-201b-4490-b1b1-810ea88d664e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] Flow 'volume_create_manager' (f3aa8e55-997c-49a8-9f16-8907390efa49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:55:12 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-145f39ac-ce36-4898-a0d2-040e9e04ea5d tempest-VolumesGetTest-150381411 None] Created volume successfully. Sep 10 19:55:12 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1138d706-9ea4-406c-97e9-b1b72f91a2a4 tempest-SnapshotsActionsTest-565968155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.07bb52e1-690e-4b62-8274-792ca41fafe9" returned: 0 in 0.288s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:12 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1138d706-9ea4-406c-97e9-b1b72f91a2a4 tempest-SnapshotsActionsTest-565968155 None] Lock "cinder-quobyte-07bb52e1-690e-4b62-8274-792ca41fafe9" released by "_delete_snapshot" :: held 2.107s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:55:12 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1138d706-9ea4-406c-97e9-b1b72f91a2a4 tempest-SnapshotsActionsTest-565968155 None] Lock "cinder-quobyte-6688cd76-af2a-4524-95ef-fdc2a62867a9" released by "delete_snapshot" :: held 2.132s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:55:12 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-1138d706-9ea4-406c-97e9-b1b72f91a2a4 tempest-SnapshotsActionsTest-565968155 None] Created reservations ['ee5f885a-7b64-449b-86f8-ab91de8fb434', '0657496b-a7dd-4b5d-92f8-2e08b5838874', 'd7f69b0b-6151-4578-a2e6-e8e40905319b', '30fab3a2-b09d-4712-ada4-1e0884095d1a'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:55:12 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-1138d706-9ea4-406c-97e9-b1b72f91a2a4 tempest-SnapshotsActionsTest-565968155 None] Delete snapshot completed successfully. Sep 10 19:55:12 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1138d706-9ea4-406c-97e9-b1b72f91a2a4 tempest-SnapshotsActionsTest-565968155 None] Lock "cinder-07bb52e1-690e-4b62-8274-792ca41fafe9-delete_snapshot" released by "delete_snapshot" :: held 2.288s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:55:13 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b75e3a04-a77f-4b25-a904-ad539bad8102 tempest-VolumesGetTest-150381411 None] Acquiring lock "cinder-9e63378d-5c7c-4caf-bdff-dc509ee50b67-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:55:13 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b75e3a04-a77f-4b25-a904-ad539bad8102 tempest-VolumesGetTest-150381411 None] Lock "cinder-9e63378d-5c7c-4caf-bdff-dc509ee50b67-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:55:13 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b75e3a04-a77f-4b25-a904-ad539bad8102 tempest-VolumesGetTest-150381411 None] Acquiring lock "cinder-quobyte-9e63378d-5c7c-4caf-bdff-dc509ee50b67" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:55:13 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b75e3a04-a77f-4b25-a904-ad539bad8102 tempest-VolumesGetTest-150381411 None] Lock "cinder-quobyte-9e63378d-5c7c-4caf-bdff-dc509ee50b67" acquired by "delete_volume" :: waited 0.025s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:55:13 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b53302-3476-45f1-a283-2a34eb6b84d1]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:55:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b75e3a04-a77f-4b25-a904-ad539bad8102 tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9e63378d-5c7c-4caf-bdff-dc509ee50b67 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:13 devstack sudo[101367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9e63378d-5c7c-4caf-bdff-dc509ee50b67 Sep 10 19:55:13 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:14 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b75e3a04-a77f-4b25-a904-ad539bad8102 tempest-VolumesGetTest-150381411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9e63378d-5c7c-4caf-bdff-dc509ee50b67" returned: 0 in 0.462s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b75e3a04-a77f-4b25-a904-ad539bad8102 tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9e63378d-5c7c-4caf-bdff-dc509ee50b67 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4e1e1372-5abb-4f21-8e40-3e5d07dbfa2f tempest-SnapshotsActionsTest-774626312 None] Acquiring lock "cinder-dfffc1c6-e21f-44b6-9662-07e479abe1ab-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:55:14 devstack sudo[101372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9e63378d-5c7c-4caf-bdff-dc509ee50b67 Sep 10 19:55:14 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4e1e1372-5abb-4f21-8e40-3e5d07dbfa2f tempest-SnapshotsActionsTest-774626312 None] Lock "cinder-dfffc1c6-e21f-44b6-9662-07e479abe1ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4e1e1372-5abb-4f21-8e40-3e5d07dbfa2f tempest-SnapshotsActionsTest-774626312 None] Acquiring lock "cinder-quobyte-6688cd76-af2a-4524-95ef-fdc2a62867a9" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4e1e1372-5abb-4f21-8e40-3e5d07dbfa2f tempest-SnapshotsActionsTest-774626312 None] Lock "cinder-quobyte-6688cd76-af2a-4524-95ef-fdc2a62867a9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4e1e1372-5abb-4f21-8e40-3e5d07dbfa2f tempest-SnapshotsActionsTest-774626312 None] Acquiring lock "cinder-quobyte-dfffc1c6-e21f-44b6-9662-07e479abe1ab" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4e1e1372-5abb-4f21-8e40-3e5d07dbfa2f tempest-SnapshotsActionsTest-774626312 None] Lock "cinder-quobyte-dfffc1c6-e21f-44b6-9662-07e479abe1ab" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-4e1e1372-5abb-4f21-8e40-3e5d07dbfa2f tempest-SnapshotsActionsTest-774626312 None] Deleting offline snapshot dfffc1c6-e21f-44b6-9662-07e479abe1ab of volume 6688cd76-af2a-4524-95ef-fdc2a62867a9 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-4e1e1372-5abb-4f21-8e40-3e5d07dbfa2f tempest-SnapshotsActionsTest-774626312 None] snapshot_file for this snap is: volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d7b47f-843d-4fe3-b335-3fe0be70e974]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4e1e1372-5abb-4f21-8e40-3e5d07dbfa2f tempest-SnapshotsActionsTest-774626312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:14 devstack sudo[101374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab Sep 10 19:55:14 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:14 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b75e3a04-a77f-4b25-a904-ad539bad8102 tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9e63378d-5c7c-4caf-bdff-dc509ee50b67" returned: 0 in 0.291s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b75e3a04-a77f-4b25-a904-ad539bad8102 tempest-VolumesGetTest-150381411 None] Lock "cinder-quobyte-9e63378d-5c7c-4caf-bdff-dc509ee50b67" released by "delete_volume" :: held 0.811s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-b75e3a04-a77f-4b25-a904-ad539bad8102 tempest-VolumesGetTest-150381411 None] Created reservations ['b741153a-2034-43ab-ad87-c59ddc1b3fc2', '68bd1204-7b19-4d18-b9b3-a7b2c4d46cfc', 'd4964ce0-9dcc-43f2-baf9-ac15b04a919b', '1d6b66e2-2f58-4bce-8bf0-f08e82906ecd'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b75e3a04-a77f-4b25-a904-ad539bad8102 tempest-VolumesGetTest-150381411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b75e3a04-a77f-4b25-a904-ad539bad8102 tempest-VolumesGetTest-150381411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b75e3a04-a77f-4b25-a904-ad539bad8102 tempest-VolumesGetTest-150381411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b75e3a04-a77f-4b25-a904-ad539bad8102 tempest-VolumesGetTest-150381411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b75e3a04-a77f-4b25-a904-ad539bad8102 tempest-VolumesGetTest-150381411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b75e3a04-a77f-4b25-a904-ad539bad8102 tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:14 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:55:14 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:14 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4e1e1372-5abb-4f21-8e40-3e5d07dbfa2f tempest-SnapshotsActionsTest-774626312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab" returned: 0 in 0.426s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-4e1e1372-5abb-4f21-8e40-3e5d07dbfa2f tempest-SnapshotsActionsTest-774626312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6688cd76-af2a-4524-95ef-fdc2a62867a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fba854-d1b8-485d-9620-d3997642d92c]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4e1e1372-5abb-4f21-8e40-3e5d07dbfa2f tempest-SnapshotsActionsTest-774626312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-15cf311e-065b-441a-8f48-5ab7ff467d7a tempest-VolumesGetTest-150381411 None] Acquiring lock "cinder-8c1b601e-0178-464a-9b52-aa5c55494e36-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-15cf311e-065b-441a-8f48-5ab7ff467d7a tempest-VolumesGetTest-150381411 None] Lock "cinder-8c1b601e-0178-464a-9b52-aa5c55494e36-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:55:14 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b75e3a04-a77f-4b25-a904-ad539bad8102 tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.341s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-b75e3a04-a77f-4b25-a904-ad539bad8102 tempest-VolumesGetTest-150381411 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:55:14 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9 Sep 10 19:55:14 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:14 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-b75e3a04-a77f-4b25-a904-ad539bad8102 tempest-VolumesGetTest-150381411 None] Deleted volume successfully. Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-15cf311e-065b-441a-8f48-5ab7ff467d7a tempest-VolumesGetTest-150381411 None] Acquiring lock "cinder-quobyte-8c1b601e-0178-464a-9b52-aa5c55494e36" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b75e3a04-a77f-4b25-a904-ad539bad8102 tempest-VolumesGetTest-150381411 None] Lock "cinder-9e63378d-5c7c-4caf-bdff-dc509ee50b67-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-15cf311e-065b-441a-8f48-5ab7ff467d7a tempest-VolumesGetTest-150381411 None] Lock "cinder-quobyte-8c1b601e-0178-464a-9b52-aa5c55494e36" acquired by "delete_volume" :: waited 0.021s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fc841f-95a2-41d7-8e3e-768bc0ae939d]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:55:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-15cf311e-065b-441a-8f48-5ab7ff467d7a tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8c1b601e-0178-464a-9b52-aa5c55494e36 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:15 devstack sudo[101386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8c1b601e-0178-464a-9b52-aa5c55494e36 Sep 10 19:55:15 devstack sudo[101386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:15 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4e1e1372-5abb-4f21-8e40-3e5d07dbfa2f tempest-SnapshotsActionsTest-774626312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9" returned: 0 in 0.543s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4e1e1372-5abb-4f21-8e40-3e5d07dbfa2f tempest-SnapshotsActionsTest-774626312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:15 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab Sep 10 19:55:15 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:15 devstack sudo[101386]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-15cf311e-065b-441a-8f48-5ab7ff467d7a tempest-VolumesGetTest-150381411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8c1b601e-0178-464a-9b52-aa5c55494e36" returned: 0 in 0.451s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-15cf311e-065b-441a-8f48-5ab7ff467d7a tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8c1b601e-0178-464a-9b52-aa5c55494e36 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:15 devstack sudo[101396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8c1b601e-0178-464a-9b52-aa5c55494e36 Sep 10 19:55:15 devstack sudo[101396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:15 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4e1e1372-5abb-4f21-8e40-3e5d07dbfa2f tempest-SnapshotsActionsTest-774626312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab" returned: 0 in 0.361s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4e1e1372-5abb-4f21-8e40-3e5d07dbfa2f tempest-SnapshotsActionsTest-774626312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:15 devstack sudo[101401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab Sep 10 19:55:15 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:15 devstack sudo[101396]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-15cf311e-065b-441a-8f48-5ab7ff467d7a tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8c1b601e-0178-464a-9b52-aa5c55494e36" returned: 0 in 0.270s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-15cf311e-065b-441a-8f48-5ab7ff467d7a tempest-VolumesGetTest-150381411 None] Lock "cinder-quobyte-8c1b601e-0178-464a-9b52-aa5c55494e36" released by "delete_volume" :: held 0.784s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:55:15 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-15cf311e-065b-441a-8f48-5ab7ff467d7a tempest-VolumesGetTest-150381411 None] Created reservations ['ab4f60a3-7856-46ce-baf1-60540a9ccef7', '3a3a0ed9-28f0-48a5-a89a-d2c47dccadc5', 'd233549f-9035-4f47-937a-6034b6228949', 'b5094448-52f8-44c5-a2cd-5a9f8e9908a8'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:55:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-15cf311e-065b-441a-8f48-5ab7ff467d7a tempest-VolumesGetTest-150381411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:55:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-15cf311e-065b-441a-8f48-5ab7ff467d7a tempest-VolumesGetTest-150381411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:55:15 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-15cf311e-065b-441a-8f48-5ab7ff467d7a tempest-VolumesGetTest-150381411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:55:15 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-15cf311e-065b-441a-8f48-5ab7ff467d7a tempest-VolumesGetTest-150381411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:55:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-15cf311e-065b-441a-8f48-5ab7ff467d7a tempest-VolumesGetTest-150381411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:55:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-15cf311e-065b-441a-8f48-5ab7ff467d7a tempest-VolumesGetTest-150381411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:15 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4e1e1372-5abb-4f21-8e40-3e5d07dbfa2f tempest-SnapshotsActionsTest-774626312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9.dfffc1c6-e21f-44b6-9662-07e479abe1ab" returned: 0 in 0.297s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:15 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:55:15 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4e1e1372-5abb-4f21-8e40-3e5d07dbfa2f tempest-SnapshotsActionsTest-774626312 None] Lock "cinder-quobyte-dfffc1c6-e21f-44b6-9662-07e479abe1ab" released by "_delete_snapshot" :: held 1.776s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:55:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4e1e1372-5abb-4f21-8e40-3e5d07dbfa2f tempest-SnapshotsActionsTest-774626312 None] Lock "cinder-quobyte-6688cd76-af2a-4524-95ef-fdc2a62867a9" released by "delete_snapshot" :: held 1.807s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:55:16 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-4e1e1372-5abb-4f21-8e40-3e5d07dbfa2f tempest-SnapshotsActionsTest-774626312 None] Created reservations ['0e5e7e78-7934-46c2-b840-47be455d97f6', 'f2aa36b6-db45-48d1-ae00-f0b94d9e058d', '41ce1b15-ec85-458c-924b-af309abbd061', '24b29787-803c-4f71-a886-860f04d6c09a'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:55:16 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-4e1e1372-5abb-4f21-8e40-3e5d07dbfa2f tempest-SnapshotsActionsTest-774626312 None] Delete snapshot completed successfully. Sep 10 19:55:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4e1e1372-5abb-4f21-8e40-3e5d07dbfa2f tempest-SnapshotsActionsTest-774626312 None] Lock "cinder-dfffc1c6-e21f-44b6-9662-07e479abe1ab-delete_snapshot" released by "delete_snapshot" :: held 2.039s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:55:16 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-15cf311e-065b-441a-8f48-5ab7ff467d7a tempest-VolumesGetTest-150381411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.360s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:16 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-15cf311e-065b-441a-8f48-5ab7ff467d7a tempest-VolumesGetTest-150381411 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:55:16 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-15cf311e-065b-441a-8f48-5ab7ff467d7a tempest-VolumesGetTest-150381411 None] Deleted volume successfully. Sep 10 19:55:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-15cf311e-065b-441a-8f48-5ab7ff467d7a tempest-VolumesGetTest-150381411 None] Lock "cinder-8c1b601e-0178-464a-9b52-aa5c55494e36-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:55:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0f2980bc-b7a1-4655-b6bc-8bf1f849352e tempest-SnapshotsActionsTest-774626312 None] Acquiring lock "cinder-6688cd76-af2a-4524-95ef-fdc2a62867a9-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:55:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0f2980bc-b7a1-4655-b6bc-8bf1f849352e tempest-SnapshotsActionsTest-774626312 None] Lock "cinder-6688cd76-af2a-4524-95ef-fdc2a62867a9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:55:16 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=106,cinder:UPDATE=129,cinder:DELETE=9,cinder:INSERT=34 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:55:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0f2980bc-b7a1-4655-b6bc-8bf1f849352e tempest-SnapshotsActionsTest-774626312 None] Acquiring lock "cinder-quobyte-6688cd76-af2a-4524-95ef-fdc2a62867a9" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:55:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0f2980bc-b7a1-4655-b6bc-8bf1f849352e tempest-SnapshotsActionsTest-774626312 None] Lock "cinder-quobyte-6688cd76-af2a-4524-95ef-fdc2a62867a9" acquired by "delete_volume" :: waited 0.018s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:55:16 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[e327e789-2f18-4ac4-a289-de63220e7d61]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:55:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0f2980bc-b7a1-4655-b6bc-8bf1f849352e tempest-SnapshotsActionsTest-774626312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:16 devstack sudo[101408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9 Sep 10 19:55:16 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:16 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0f2980bc-b7a1-4655-b6bc-8bf1f849352e tempest-SnapshotsActionsTest-774626312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9" returned: 0 in 0.378s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0f2980bc-b7a1-4655-b6bc-8bf1f849352e tempest-SnapshotsActionsTest-774626312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:16 devstack sudo[101413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9 Sep 10 19:55:16 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:17 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0f2980bc-b7a1-4655-b6bc-8bf1f849352e tempest-SnapshotsActionsTest-774626312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6688cd76-af2a-4524-95ef-fdc2a62867a9" returned: 0 in 0.460s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:17 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0f2980bc-b7a1-4655-b6bc-8bf1f849352e tempest-SnapshotsActionsTest-774626312 None] Lock "cinder-quobyte-6688cd76-af2a-4524-95ef-fdc2a62867a9" released by "delete_volume" :: held 0.924s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:55:17 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-0f2980bc-b7a1-4655-b6bc-8bf1f849352e tempest-SnapshotsActionsTest-774626312 None] Created reservations ['5a8539e3-71d0-4507-9c17-2d8b8f7bc135', '53c5986f-5837-4b9b-b0f8-26880f7c8abd', '68c2a8db-6c5e-4e28-99d1-e18ca461659c', 'cca41418-5479-4fa6-be28-8ca37a7bc642'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:55:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0f2980bc-b7a1-4655-b6bc-8bf1f849352e tempest-SnapshotsActionsTest-774626312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:55:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0f2980bc-b7a1-4655-b6bc-8bf1f849352e tempest-SnapshotsActionsTest-774626312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:55:17 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0f2980bc-b7a1-4655-b6bc-8bf1f849352e tempest-SnapshotsActionsTest-774626312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:55:17 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0f2980bc-b7a1-4655-b6bc-8bf1f849352e tempest-SnapshotsActionsTest-774626312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:55:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0f2980bc-b7a1-4655-b6bc-8bf1f849352e tempest-SnapshotsActionsTest-774626312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:55:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0f2980bc-b7a1-4655-b6bc-8bf1f849352e tempest-SnapshotsActionsTest-774626312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:17 devstack sudo[101416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:55:17 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:17 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0f2980bc-b7a1-4655-b6bc-8bf1f849352e tempest-SnapshotsActionsTest-774626312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.273s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:17 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-0f2980bc-b7a1-4655-b6bc-8bf1f849352e tempest-SnapshotsActionsTest-774626312 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:55:17 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-0f2980bc-b7a1-4655-b6bc-8bf1f849352e tempest-SnapshotsActionsTest-774626312 None] Deleted volume successfully. Sep 10 19:55:17 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0f2980bc-b7a1-4655-b6bc-8bf1f849352e tempest-SnapshotsActionsTest-774626312 None] Lock "cinder-6688cd76-af2a-4524-95ef-fdc2a62867a9-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:55:27 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=7 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:55:27 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=112,cinder:INSERT=45,cinder:UPDATE=126,cinder:DELETE=12 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:55:40 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:55:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Flow 'volume_create_manager' (54e57109-4e73-4de9-bc1f-f21b878bbada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:55:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6af10d3e-85b3-410c-a6bf-2af4074166fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6af10d3e-85b3-410c-a6bf-2af4074166fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-664677151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e74e05-570c-417d-b97e-237a03464576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d15ed460a3147b38b17b566514deef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:55:41Z,use_quota=True,user_id='5d030d1589614a2aa5c175fd8091abee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (709b7188-1f43-493b-b518-8c9781124270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (709b7188-1f43-493b-b518-8c9781124270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41d9322-e06f-4bf5-b8f0-fae8c6547bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41d9322-e06f-4bf5-b8f0-fae8c6547bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72e74e05-570c-417d-b97e-237a03464576', 'volume_name': 'volume-72e74e05-570c-417d-b97e-237a03464576', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c11e7b-3253-4740-ac04-939c612ad079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c11e7b-3253-4740-ac04-939c612ad079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40649a65-7f2e-49a4-bd20-d350c0dcceb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:40 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Volume 72e74e05-570c-417d-b97e-237a03464576: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72e74e05-570c-417d-b97e-237a03464576', 'volume_size': 1} Sep 10 19:55:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:55:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:55:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-664677151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e74e05-570c-417d-b97e-237a03464576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d15ed460a3147b38b17b566514deef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:55:41Z,use_quota=True,user_id='5d030d1589614a2aa5c175fd8091abee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:55:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Creating volume 72e74e05-570c-417d-b97e-237a03464576 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:55:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:55:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:55:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:55:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:55:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:55:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:55:40 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:55:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-72e74e05-570c-417d-b97e-237a03464576 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:40 devstack sudo[101482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-72e74e05-570c-417d-b97e-237a03464576 1073741824 Sep 10 19:55:40 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:41 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-72e74e05-570c-417d-b97e-237a03464576 1073741824" returned: 0 in 0.718s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-72e74e05-570c-417d-b97e-237a03464576 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:41 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-72e74e05-570c-417d-b97e-237a03464576 Sep 10 19:55:41 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:41 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-72e74e05-570c-417d-b97e-237a03464576" returned: 0 in 0.335s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:55:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:55:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40649a65-7f2e-49a4-bd20-d350c0dcceb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72e74e05-570c-417d-b97e-237a03464576', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36cd3b97-53d9-4940-b156-ffa1a838eec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:42 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Volume volume-72e74e05-570c-417d-b97e-237a03464576 (72e74e05-570c-417d-b97e-237a03464576): created successfully Sep 10 19:55:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36cd3b97-53d9-4940-b156-ffa1a838eec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Flow 'volume_create_manager' (54e57109-4e73-4de9-bc1f-f21b878bbada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:55:42 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-2cab6cc6-3de3-404b-b89f-4c71c33e0720 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Created volume successfully. Sep 10 19:55:43 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:55:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] Flow 'volume_create_manager' (eaedeccd-b991-4aef-ae7b-58f6f7c0da95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:55:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f538ef-32b5-4517-b699-079141e5b4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f538ef-32b5-4517-b699-079141e5b4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1173526376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9c98e22-4f75-4eef-b06c-ab961bab6179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64eea74213bd4a07852ecad5c1ecb9e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:55:43Z,use_quota=True,user_id='87f350fadbbb4ceb86ae537b7968333a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e113c96-3b4d-4644-96f8-a4ea320ecc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e113c96-3b4d-4644-96f8-a4ea320ecc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b47e65f-24dd-4443-975b-f524db19354d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b47e65f-24dd-4443-975b-f524db19354d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9c98e22-4f75-4eef-b06c-ab961bab6179', 'volume_name': 'volume-e9c98e22-4f75-4eef-b06c-ab961bab6179', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c98536-be27-45da-8cf2-10a5885953a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c98536-be27-45da-8cf2-10a5885953a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f1939a-e002-4714-9a9e-7e6b33fa4bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:43 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] Volume e9c98e22-4f75-4eef-b06c-ab961bab6179: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9c98e22-4f75-4eef-b06c-ab961bab6179', 'volume_size': 1} Sep 10 19:55:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:55:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:55:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1173526376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9c98e22-4f75-4eef-b06c-ab961bab6179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64eea74213bd4a07852ecad5c1ecb9e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:55:43Z,use_quota=True,user_id='87f350fadbbb4ceb86ae537b7968333a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:55:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] Creating volume e9c98e22-4f75-4eef-b06c-ab961bab6179 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:55:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:55:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:55:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:55:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:55:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:55:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:55:43 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:55:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:43 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179 1073741824 Sep 10 19:55:43 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:44 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179 1073741824" returned: 0 in 1.060s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:44 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179 Sep 10 19:55:44 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-77ba6034-86c6-4ccb-ba46-ab5b0bf26b21 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Acquiring lock "cinder-72e74e05-570c-417d-b97e-237a03464576-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:55:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-77ba6034-86c6-4ccb-ba46-ab5b0bf26b21 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Lock "cinder-72e74e05-570c-417d-b97e-237a03464576-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:55:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-77ba6034-86c6-4ccb-ba46-ab5b0bf26b21 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Acquiring lock "cinder-quobyte-72e74e05-570c-417d-b97e-237a03464576" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:55:45 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-77ba6034-86c6-4ccb-ba46-ab5b0bf26b21 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Lock "cinder-quobyte-72e74e05-570c-417d-b97e-237a03464576" acquired by "delete_volume" :: waited 0.053s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:55:45 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[9417ecf2-ae33-4251-afe3-a1ba79860222]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:55:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-77ba6034-86c6-4ccb-ba46-ab5b0bf26b21 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-72e74e05-570c-417d-b97e-237a03464576 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:45 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179" returned: 0 in 0.409s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:55:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:55:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f1939a-e002-4714-9a9e-7e6b33fa4bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9c98e22-4f75-4eef-b06c-ab961bab6179', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6298df79-1378-41f1-bb54-a51ae4f8fd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:45 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] Volume volume-e9c98e22-4f75-4eef-b06c-ab961bab6179 (e9c98e22-4f75-4eef-b06c-ab961bab6179): created successfully Sep 10 19:55:45 devstack sudo[101569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-72e74e05-570c-417d-b97e-237a03464576 Sep 10 19:55:45 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6298df79-1378-41f1-bb54-a51ae4f8fd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] Flow 'volume_create_manager' (eaedeccd-b991-4aef-ae7b-58f6f7c0da95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:55:45 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-f349ed86-38ad-43ad-8ecf-596818c8cc3c tempest-VolumesSnapshotTestJSON-1101333329 None] Created volume successfully. Sep 10 19:55:45 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-77ba6034-86c6-4ccb-ba46-ab5b0bf26b21 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-72e74e05-570c-417d-b97e-237a03464576" returned: 0 in 0.522s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-77ba6034-86c6-4ccb-ba46-ab5b0bf26b21 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-72e74e05-570c-417d-b97e-237a03464576 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:45 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-72e74e05-570c-417d-b97e-237a03464576 Sep 10 19:55:45 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:45 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-77ba6034-86c6-4ccb-ba46-ab5b0bf26b21 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-72e74e05-570c-417d-b97e-237a03464576" returned: 0 in 0.385s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:46 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-77ba6034-86c6-4ccb-ba46-ab5b0bf26b21 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Lock "cinder-quobyte-72e74e05-570c-417d-b97e-237a03464576" released by "delete_volume" :: held 1.002s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:55:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f01e79aa-6bbe-4500-8dfe-e5174a62a63a tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:55:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f01e79aa-6bbe-4500-8dfe-e5174a62a63a tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:55:46 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-f01e79aa-6bbe-4500-8dfe-e5174a62a63a tempest-VolumesSnapshotTestJSON-1101333329 None] Creating offline snapshot 8d8efe50-97b1-466d-8683-5e4139e8988c of volume e9c98e22-4f75-4eef-b06c-ab961bab6179 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 19:55:46 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6d53fa-9272-4e58-928f-046b8a1c0b06]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:55:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f01e79aa-6bbe-4500-8dfe-e5174a62a63a tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:46 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-77ba6034-86c6-4ccb-ba46-ab5b0bf26b21 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Created reservations ['4b25007a-9165-4d81-a151-93626f6727db', '3831a209-b295-45f9-8435-8ce0e41b73ae', '782cba76-24f4-45c0-b3b8-1ccbbb93fe27', '35625c5a-1880-4243-90a0-8ae70b8f993e'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:55:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-77ba6034-86c6-4ccb-ba46-ab5b0bf26b21 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:55:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-77ba6034-86c6-4ccb-ba46-ab5b0bf26b21 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:55:46 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-77ba6034-86c6-4ccb-ba46-ab5b0bf26b21 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:55:46 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179 Sep 10 19:55:46 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:46 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-77ba6034-86c6-4ccb-ba46-ab5b0bf26b21 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:55:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-77ba6034-86c6-4ccb-ba46-ab5b0bf26b21 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:55:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-77ba6034-86c6-4ccb-ba46-ab5b0bf26b21 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:46 devstack sudo[101583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:55:46 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:46 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f01e79aa-6bbe-4500-8dfe-e5174a62a63a tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179" returned: 0 in 0.478s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f01e79aa-6bbe-4500-8dfe-e5174a62a63a tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179.8d8efe50-97b1-466d-8683-5e4139e8988c 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:46 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-77ba6034-86c6-4ccb-ba46-ab5b0bf26b21 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.344s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:46 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-77ba6034-86c6-4ccb-ba46-ab5b0bf26b21 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:55:46 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-77ba6034-86c6-4ccb-ba46-ab5b0bf26b21 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Deleted volume successfully. Sep 10 19:55:46 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179.8d8efe50-97b1-466d-8683-5e4139e8988c 1G Sep 10 19:55:46 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:46 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-77ba6034-86c6-4ccb-ba46-ab5b0bf26b21 tempest-VolumeQuotasNegativeTestJSON-1648537660 None] Lock "cinder-72e74e05-570c-417d-b97e-237a03464576-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:55:47 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f01e79aa-6bbe-4500-8dfe-e5174a62a63a tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179.8d8efe50-97b1-466d-8683-5e4139e8988c 1G" returned: 0 in 0.590s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f01e79aa-6bbe-4500-8dfe-e5174a62a63a tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9c98e22-4f75-4eef-b06c-ab961bab6179 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179.8d8efe50-97b1-466d-8683-5e4139e8988c {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:47 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9c98e22-4f75-4eef-b06c-ab961bab6179 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179.8d8efe50-97b1-466d-8683-5e4139e8988c Sep 10 19:55:47 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:47 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f01e79aa-6bbe-4500-8dfe-e5174a62a63a tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9c98e22-4f75-4eef-b06c-ab961bab6179 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179.8d8efe50-97b1-466d-8683-5e4139e8988c" returned: 0 in 0.412s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:47 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-f01e79aa-6bbe-4500-8dfe-e5174a62a63a tempest-VolumesSnapshotTestJSON-1101333329 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179.8d8efe50-97b1-466d-8683-5e4139e8988c is being set with open permissions: ugo+rw Sep 10 19:55:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f01e79aa-6bbe-4500-8dfe-e5174a62a63a tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179.8d8efe50-97b1-466d-8683-5e4139e8988c {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:47 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179.8d8efe50-97b1-466d-8683-5e4139e8988c Sep 10 19:55:47 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:47 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f01e79aa-6bbe-4500-8dfe-e5174a62a63a tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179.8d8efe50-97b1-466d-8683-5e4139e8988c" returned: 0 in 0.310s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f01e79aa-6bbe-4500-8dfe-e5174a62a63a tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:47 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179.info Sep 10 19:55:47 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:48 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f01e79aa-6bbe-4500-8dfe-e5174a62a63a tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179.info" returned: 0 in 0.341s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:48 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-f01e79aa-6bbe-4500-8dfe-e5174a62a63a tempest-VolumesSnapshotTestJSON-1101333329 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179.info is being set with open permissions: ugo+rw Sep 10 19:55:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f01e79aa-6bbe-4500-8dfe-e5174a62a63a tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:48 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179.info Sep 10 19:55:48 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:48 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f01e79aa-6bbe-4500-8dfe-e5174a62a63a tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179.info" returned: 0 in 0.307s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f01e79aa-6bbe-4500-8dfe-e5174a62a63a tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.573s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:55:48 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-f01e79aa-6bbe-4500-8dfe-e5174a62a63a tempest-VolumesSnapshotTestJSON-1101333329 None] Create snapshot completed successfully Sep 10 19:55:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c11811a2-586e-43d8-9a7b-b65f742e9f20 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "cinder-8d8efe50-97b1-466d-8683-5e4139e8988c-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:55:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c11811a2-586e-43d8-9a7b-b65f742e9f20 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-8d8efe50-97b1-466d-8683-5e4139e8988c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:55:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c11811a2-586e-43d8-9a7b-b65f742e9f20 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "cinder-quobyte-e9c98e22-4f75-4eef-b06c-ab961bab6179" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:55:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c11811a2-586e-43d8-9a7b-b65f742e9f20 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-quobyte-e9c98e22-4f75-4eef-b06c-ab961bab6179" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:55:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c11811a2-586e-43d8-9a7b-b65f742e9f20 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "cinder-quobyte-8d8efe50-97b1-466d-8683-5e4139e8988c" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:55:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c11811a2-586e-43d8-9a7b-b65f742e9f20 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-quobyte-8d8efe50-97b1-466d-8683-5e4139e8988c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:55:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-c11811a2-586e-43d8-9a7b-b65f742e9f20 tempest-VolumesSnapshotTestJSON-1101333329 None] Deleting offline snapshot 8d8efe50-97b1-466d-8683-5e4139e8988c of volume e9c98e22-4f75-4eef-b06c-ab961bab6179 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 19:55:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-c11811a2-586e-43d8-9a7b-b65f742e9f20 tempest-VolumesSnapshotTestJSON-1101333329 None] snapshot_file for this snap is: volume-e9c98e22-4f75-4eef-b06c-ab961bab6179.8d8efe50-97b1-466d-8683-5e4139e8988c {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 19:55:49 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb15b94a-cbaa-455b-b60e-c6b8cc754072]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:55:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c11811a2-586e-43d8-9a7b-b65f742e9f20 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179.8d8efe50-97b1-466d-8683-5e4139e8988c {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:49 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179.8d8efe50-97b1-466d-8683-5e4139e8988c Sep 10 19:55:49 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:50 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c11811a2-586e-43d8-9a7b-b65f742e9f20 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179.8d8efe50-97b1-466d-8683-5e4139e8988c" returned: 0 in 0.504s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:50 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-c11811a2-586e-43d8-9a7b-b65f742e9f20 tempest-VolumesSnapshotTestJSON-1101333329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9c98e22-4f75-4eef-b06c-ab961bab6179(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:55:50 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[b634c205-866d-44fe-9a03-83cc11f2cafb]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:55:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c11811a2-586e-43d8-9a7b-b65f742e9f20 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:50 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179 Sep 10 19:55:50 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:50 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c11811a2-586e-43d8-9a7b-b65f742e9f20 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179" returned: 0 in 0.461s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c11811a2-586e-43d8-9a7b-b65f742e9f20 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179.8d8efe50-97b1-466d-8683-5e4139e8988c {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:50 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179.8d8efe50-97b1-466d-8683-5e4139e8988c Sep 10 19:55:50 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:51 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c11811a2-586e-43d8-9a7b-b65f742e9f20 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179.8d8efe50-97b1-466d-8683-5e4139e8988c" returned: 0 in 0.459s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c11811a2-586e-43d8-9a7b-b65f742e9f20 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179.8d8efe50-97b1-466d-8683-5e4139e8988c {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:51 devstack sudo[101645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179.8d8efe50-97b1-466d-8683-5e4139e8988c Sep 10 19:55:51 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:51 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c11811a2-586e-43d8-9a7b-b65f742e9f20 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179.8d8efe50-97b1-466d-8683-5e4139e8988c" returned: 0 in 0.267s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c11811a2-586e-43d8-9a7b-b65f742e9f20 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-quobyte-8d8efe50-97b1-466d-8683-5e4139e8988c" released by "_delete_snapshot" :: held 1.843s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:55:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c11811a2-586e-43d8-9a7b-b65f742e9f20 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-quobyte-e9c98e22-4f75-4eef-b06c-ab961bab6179" released by "delete_snapshot" :: held 1.874s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:55:51 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-c11811a2-586e-43d8-9a7b-b65f742e9f20 tempest-VolumesSnapshotTestJSON-1101333329 None] Created reservations ['c536e73d-2330-4787-9127-7684630d4cf9', '18570261-c9f9-478c-ab11-6942e70e0eb6', 'f8fc04d6-a1c4-497b-ac9b-aaa584d3c34a', '4827b8d4-c22e-4cdc-9caa-2b35d2840bef'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:55:51 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-c11811a2-586e-43d8-9a7b-b65f742e9f20 tempest-VolumesSnapshotTestJSON-1101333329 None] Delete snapshot completed successfully. Sep 10 19:55:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c11811a2-586e-43d8-9a7b-b65f742e9f20 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-8d8efe50-97b1-466d-8683-5e4139e8988c-delete_snapshot" released by "delete_snapshot" :: held 2.130s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:55:53 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:55:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] Flow 'volume_create_manager' (9daf2d86-947f-4055-af52-044fa7babb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:55:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88b4c03-e549-4f1e-bdc8-86b5f2b534ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88b4c03-e549-4f1e-bdc8-86b5f2b534ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-476717667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64eea74213bd4a07852ecad5c1ecb9e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:55:53Z,use_quota=True,user_id='87f350fadbbb4ceb86ae537b7968333a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d595a939-27b7-4ec6-9081-f8dc563ef455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d595a939-27b7-4ec6-9081-f8dc563ef455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f73b52-2936-443a-b73d-25541e0037ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f73b52-2936-443a-b73d-25541e0037ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731', 'volume_name': 'volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a779a0ca-3da1-4d1d-889f-d9e0a6ec4ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a779a0ca-3da1-4d1d-889f-d9e0a6ec4ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:53 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad428fb-1fc7-4052-bfb9-f02acab1c95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:53 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] Volume 60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731', 'volume_size': 1} Sep 10 19:55:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:55:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:55:53 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-476717667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64eea74213bd4a07852ecad5c1ecb9e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:55:53Z,use_quota=True,user_id='87f350fadbbb4ceb86ae537b7968333a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:55:53 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] Creating volume 60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:55:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:55:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:55:53 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:55:53 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:55:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:55:53 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:55:53 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:55:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:53 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731 1073741824 Sep 10 19:55:53 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:53 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731 1073741824" returned: 0 in 0.479s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:54 devstack sudo[101654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731 Sep 10 19:55:54 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:54 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731" returned: 0 in 0.278s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:54 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:55:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:55:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad428fb-1fc7-4052-bfb9-f02acab1c95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd76a8cb-716c-4143-b999-e484c051b3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:54 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] Volume volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731 (60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731): created successfully Sep 10 19:55:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd76a8cb-716c-4143-b999-e484c051b3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] Flow 'volume_create_manager' (9daf2d86-947f-4055-af52-044fa7babb9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:55:54 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-d26ffdbb-7603-479a-bc18-3d43d3e85a1d tempest-VolumesSnapshotTestJSON-1101333329 None] Created volume successfully. Sep 10 19:55:54 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:55:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Flow 'volume_create_manager' (c609525b-5798-4f99-b799-5b4bc93dcd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:55:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d8245ba-4c73-4bb3-9536-87c126b2c990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d8245ba-4c73-4bb3-9536-87c126b2c990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-894629453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe6935b-1228-49bd-bfd5-13fa74a8abdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f37bebafe8144fe8b6ccc6f28da46fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:55:55Z,use_quota=True,user_id='d9ef6c39364846aa9b4fb489c8bca7db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f5bd84b-5938-4332-87fc-470bb6db1af3),volume_type_id=3f5bd84b-5938-4332-87fc-470bb6db1af3)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c9f9923-11e4-420e-a248-f6ef070451cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c9f9923-11e4-420e-a248-f6ef070451cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9859070b-adfd-44ff-93fc-c59c453092e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9859070b-adfd-44ff-93fc-c59c453092e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afe6935b-1228-49bd-bfd5-13fa74a8abdb', 'volume_name': 'volume-afe6935b-1228-49bd-bfd5-13fa74a8abdb', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c553bc9a-740d-4828-8225-3516672e39ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c553bc9a-740d-4828-8225-3516672e39ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (489175cb-47e3-4304-80a0-43f7b6fce51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:54 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Volume afe6935b-1228-49bd-bfd5-13fa74a8abdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afe6935b-1228-49bd-bfd5-13fa74a8abdb', 'volume_size': 1} Sep 10 19:55:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:55:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:55:54 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-894629453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe6935b-1228-49bd-bfd5-13fa74a8abdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f37bebafe8144fe8b6ccc6f28da46fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:55:55Z,use_quota=True,user_id='d9ef6c39364846aa9b4fb489c8bca7db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f5bd84b-5938-4332-87fc-470bb6db1af3),volume_type_id=3f5bd84b-5938-4332-87fc-470bb6db1af3)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:55:54 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Creating volume afe6935b-1228-49bd-bfd5-13fa74a8abdb {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:55:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:55:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:55:54 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:55:54 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:55:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:55:54 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:55:54 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:55:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-afe6935b-1228-49bd-bfd5-13fa74a8abdb 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:55 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-afe6935b-1228-49bd-bfd5-13fa74a8abdb 1073741824 Sep 10 19:55:55 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:55 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-afe6935b-1228-49bd-bfd5-13fa74a8abdb 1073741824" returned: 0 in 0.509s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-afe6935b-1228-49bd-bfd5-13fa74a8abdb {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:55 devstack sudo[101663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-afe6935b-1228-49bd-bfd5-13fa74a8abdb Sep 10 19:55:55 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a31cb111-f20f-4452-9ee8-875b02e9d3b5 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:55:55 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-afe6935b-1228-49bd-bfd5-13fa74a8abdb" returned: 0 in 0.280s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:55 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:55:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:55:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a31cb111-f20f-4452-9ee8-875b02e9d3b5 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.212s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:55:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (489175cb-47e3-4304-80a0-43f7b6fce51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afe6935b-1228-49bd-bfd5-13fa74a8abdb', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b9edab-cd38-4954-ac84-274398a3fed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:55 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-a31cb111-f20f-4452-9ee8-875b02e9d3b5 tempest-VolumesSnapshotTestJSON-1101333329 None] Creating offline snapshot 9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf of volume 60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 19:55:55 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Volume volume-afe6935b-1228-49bd-bfd5-13fa74a8abdb (afe6935b-1228-49bd-bfd5-13fa74a8abdb): created successfully Sep 10 19:55:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b9edab-cd38-4954-ac84-274398a3fed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Flow 'volume_create_manager' (c609525b-5798-4f99-b799-5b4bc93dcd81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:55:55 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[898175eb-fb02-4b5e-b811-aed3d7c9f14d]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:55:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a31cb111-f20f-4452-9ee8-875b02e9d3b5 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:55 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-c3d8cb11-e7e8-4ed8-95e9-1c293a870883 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Created volume successfully. Sep 10 19:55:56 devstack sudo[101666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731 Sep 10 19:55:56 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:56 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a31cb111-f20f-4452-9ee8-875b02e9d3b5 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731" returned: 0 in 0.418s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a31cb111-f20f-4452-9ee8-875b02e9d3b5 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731.9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:56 devstack sudo[101671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731.9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf 1G Sep 10 19:55:56 devstack sudo[101671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:56 devstack sudo[101671]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a31cb111-f20f-4452-9ee8-875b02e9d3b5 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731.9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf 1G" returned: 0 in 0.467s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a31cb111-f20f-4452-9ee8-875b02e9d3b5 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731.9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:56 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731.9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf Sep 10 19:55:56 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:57 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a31cb111-f20f-4452-9ee8-875b02e9d3b5 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731.9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf" returned: 0 in 0.494s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:57 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-a31cb111-f20f-4452-9ee8-875b02e9d3b5 tempest-VolumesSnapshotTestJSON-1101333329 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731.9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf is being set with open permissions: ugo+rw Sep 10 19:55:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a31cb111-f20f-4452-9ee8-875b02e9d3b5 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731.9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:57 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731.9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf Sep 10 19:55:57 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-dc35607f-fd8d-4d9b-a6db-0523f55fcb11 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:55:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-dc35607f-fd8d-4d9b-a6db-0523f55fcb11 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:55:57 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-dc35607f-fd8d-4d9b-a6db-0523f55fcb11 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:55:57 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-dc35607f-fd8d-4d9b-a6db-0523f55fcb11 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:55:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-dc35607f-fd8d-4d9b-a6db-0523f55fcb11 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:55:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-dc35607f-fd8d-4d9b-a6db-0523f55fcb11 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:57 devstack sudo[101684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:55:57 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:57 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a31cb111-f20f-4452-9ee8-875b02e9d3b5 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731.9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf" returned: 0 in 0.274s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a31cb111-f20f-4452-9ee8-875b02e9d3b5 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:57 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731.info Sep 10 19:55:57 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:57 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-dc35607f-fd8d-4d9b-a6db-0523f55fcb11 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.273s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:57 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-dc35607f-fd8d-4d9b-a6db-0523f55fcb11 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:55:57 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-dc35607f-fd8d-4d9b-a6db-0523f55fcb11 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Retype volume completed successfully. Sep 10 19:55:57 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a31cb111-f20f-4452-9ee8-875b02e9d3b5 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731.info" returned: 0 in 0.268s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:57 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-a31cb111-f20f-4452-9ee8-875b02e9d3b5 tempest-VolumesSnapshotTestJSON-1101333329 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731.info is being set with open permissions: ugo+rw Sep 10 19:55:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a31cb111-f20f-4452-9ee8-875b02e9d3b5 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:57 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731.info Sep 10 19:55:57 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:58 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a31cb111-f20f-4452-9ee8-875b02e9d3b5 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731.info" returned: 0 in 0.288s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a31cb111-f20f-4452-9ee8-875b02e9d3b5 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.319s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:55:58 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-a31cb111-f20f-4452-9ee8-875b02e9d3b5 tempest-VolumesSnapshotTestJSON-1101333329 None] Create snapshot completed successfully Sep 10 19:55:58 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b99bc2cc-9e33-47e5-aafe-a157c31b86f8 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Acquiring lock "cinder-afe6935b-1228-49bd-bfd5-13fa74a8abdb-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:55:58 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b99bc2cc-9e33-47e5-aafe-a157c31b86f8 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Lock "cinder-afe6935b-1228-49bd-bfd5-13fa74a8abdb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:55:58 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b99bc2cc-9e33-47e5-aafe-a157c31b86f8 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Acquiring lock "cinder-quobyte-afe6935b-1228-49bd-bfd5-13fa74a8abdb" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:55:58 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b99bc2cc-9e33-47e5-aafe-a157c31b86f8 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Lock "cinder-quobyte-afe6935b-1228-49bd-bfd5-13fa74a8abdb" acquired by "delete_volume" :: waited 0.017s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:55:58 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[684c25fb-9162-47a8-8c00-b76ce820fb2a]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:55:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b99bc2cc-9e33-47e5-aafe-a157c31b86f8 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-afe6935b-1228-49bd-bfd5-13fa74a8abdb {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:58 devstack sudo[101709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-afe6935b-1228-49bd-bfd5-13fa74a8abdb Sep 10 19:55:58 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:59 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b99bc2cc-9e33-47e5-aafe-a157c31b86f8 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-afe6935b-1228-49bd-bfd5-13fa74a8abdb" returned: 0 in 0.426s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b99bc2cc-9e33-47e5-aafe-a157c31b86f8 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-afe6935b-1228-49bd-bfd5-13fa74a8abdb {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:59 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-afe6935b-1228-49bd-bfd5-13fa74a8abdb Sep 10 19:55:59 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:59 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b99bc2cc-9e33-47e5-aafe-a157c31b86f8 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-afe6935b-1228-49bd-bfd5-13fa74a8abdb" returned: 0 in 0.308s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b99bc2cc-9e33-47e5-aafe-a157c31b86f8 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Lock "cinder-quobyte-afe6935b-1228-49bd-bfd5-13fa74a8abdb" released by "delete_volume" :: held 0.781s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Flow 'volume_create_manager' (700a5bca-95a0-4a5c-b7f2-0451d2c6e213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4acdbac0-ca4b-4517-9219-d12a078de035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4acdbac0-ca4b-4517-9219-d12a078de035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-200810868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=291fce27-5a34-4ec0-90bc-73bc4d43cecd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64eea74213bd4a07852ecad5c1ecb9e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:55:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:55:59Z,use_quota=True,user_id='87f350fadbbb4ceb86ae537b7968333a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab70f8da-8f32-4f83-94bf-dd1d29470201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab70f8da-8f32-4f83-94bf-dd1d29470201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (101612c0-7b47-4bf9-a698-66cdbe677b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (101612c0-7b47-4bf9-a698-66cdbe677b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '291fce27-5a34-4ec0-90bc-73bc4d43cecd', 'volume_name': 'volume-291fce27-5a34-4ec0-90bc-73bc4d43cecd', 'volume_size': 2, 'snapshot_id': '9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf'}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e331d045-7c63-43d9-8c33-fdda187ea828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e331d045-7c63-43d9-8c33-fdda187ea828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a37f52a-108a-4e93-9a19-4602c0d4c926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:55:59 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Volume 291fce27-5a34-4ec0-90bc-73bc4d43cecd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-291fce27-5a34-4ec0-90bc-73bc4d43cecd', 'volume_size': 2, 'snapshot_id': '9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf'} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "cinder-quobyte-9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf-291fce27-5a34-4ec0-90bc-73bc4d43cecd" by "_create_volume_from_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:55:59 devstack cinder-volume[88093]: WARNING cinder.quota [None req-b99bc2cc-9e33-47e5-aafe-a157c31b86f8 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:55:59 devstack cinder-volume[88093]: WARNING cinder.quota [None req-b99bc2cc-9e33-47e5-aafe-a157c31b86f8 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-quobyte-9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf-291fce27-5a34-4ec0-90bc-73bc4d43cecd" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Creating volume 291fce27-5a34-4ec0-90bc-73bc4d43cecd from snapshot 9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf {{(pid=88093) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "cinder-quobyte-291fce27-5a34-4ec0-90bc-73bc4d43cecd" by "_copy_volume_from_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-quobyte-291fce27-5a34-4ec0-90bc-73bc4d43cecd" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] snapshot: 9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf, volume: 291fce27-5a34-4ec0-90bc-73bc4d43cecd, {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-b99bc2cc-9e33-47e5-aafe-a157c31b86f8 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Created reservations ['72bb78c3-a78d-4d7e-98df-fce0b1139377', '39e217ea-4f82-4db8-bee8-f2f97eece742', '3d78b12e-6ec0-431d-98fb-5cdae6984b68', 'd74448e1-5686-4667-8390-b39c4ad1350c'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[6022be14-1229-4313-9fc8-f0cecf14855d]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731.9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b99bc2cc-9e33-47e5-aafe-a157c31b86f8 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b99bc2cc-9e33-47e5-aafe-a157c31b86f8 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b99bc2cc-9e33-47e5-aafe-a157c31b86f8 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b99bc2cc-9e33-47e5-aafe-a157c31b86f8 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b99bc2cc-9e33-47e5-aafe-a157c31b86f8 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:55:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b99bc2cc-9e33-47e5-aafe-a157c31b86f8 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:55:59 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:55:59 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:55:59 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731.9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf Sep 10 19:55:59 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:00 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b99bc2cc-9e33-47e5-aafe-a157c31b86f8 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.297s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:00 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-b99bc2cc-9e33-47e5-aafe-a157c31b86f8 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:56:00 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-b99bc2cc-9e33-47e5-aafe-a157c31b86f8 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Deleted volume successfully. Sep 10 19:56:00 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b99bc2cc-9e33-47e5-aafe-a157c31b86f8 tempest-VolumeRetypeWithoutMigrationTest-1798364733 None] Lock "cinder-afe6935b-1228-49bd-bfd5-13fa74a8abdb-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:00 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731.9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf" returned: 0 in 0.429s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:00 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:56:00 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0932304-4d0f-4509-89bf-bd784fd97346]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:56:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:00 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731 Sep 10 19:56:00 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:00 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731" returned: 0 in 0.371s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:00 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731 {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 19:56:00 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Creating direct copy from snapshot {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 19:56:00 devstack cinder-volume[88093]: DEBUG cinder.utils [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Path /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-291fce27-5a34-4ec0-90bc-73bc4d43cecd not found in is_blk_device check {{(pid=88093) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 19:56:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-291fce27-5a34-4ec0-90bc-73bc4d43cecd {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:00 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-291fce27-5a34-4ec0-90bc-73bc4d43cecd Sep 10 19:56:00 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:03 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:56:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:56:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:56:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:56:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:56:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:56:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:04 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:56:04 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:04 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.547s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:04 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:56:04 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager._thread_info {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:56:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread count: 28 {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 19:56:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread info: [<_MainThread(MainThread, started 138417491665024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 19:56:05 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-291fce27-5a34-4ec0-90bc-73bc4d43cecd" returned: 0 in 5.146s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:05 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Image conversion details: src /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731, size 1024.00 MB, duration 5.15 sec, destination /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-291fce27-5a34-4ec0-90bc-73bc4d43cecd {{(pid=88093) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 19:56:05 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Converted 1024.00 MB image at 198.94 MB/s Sep 10 19:56:05 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-291fce27-5a34-4ec0-90bc-73bc4d43cecd is being set with open permissions: ugo+rw Sep 10 19:56:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-291fce27-5a34-4ec0-90bc-73bc4d43cecd {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:05 devstack sudo[101747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-291fce27-5a34-4ec0-90bc-73bc4d43cecd Sep 10 19:56:05 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:05 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-291fce27-5a34-4ec0-90bc-73bc4d43cecd" returned: 0 in 0.320s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:05 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-quobyte-291fce27-5a34-4ec0-90bc-73bc4d43cecd" released by "_copy_volume_from_snapshot" :: held 6.365s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-quobyte-9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf-291fce27-5a34-4ec0-90bc-73bc4d43cecd" released by "_create_volume_from_snapshot" :: held 6.458s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.480s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:56:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a37f52a-108a-4e93-9a19-4602c0d4c926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-291fce27-5a34-4ec0-90bc-73bc4d43cecd', 'volume_size': 2, 'snapshot_id': '9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf'}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14622cf1-4f2c-43b5-85ff-5cce48729967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:06 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Volume volume-291fce27-5a34-4ec0-90bc-73bc4d43cecd (291fce27-5a34-4ec0-90bc-73bc4d43cecd): created successfully Sep 10 19:56:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14622cf1-4f2c-43b5-85ff-5cce48729967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Flow 'volume_create_manager' (700a5bca-95a0-4a5c-b7f2-0451d2c6e213) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:56:06 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-5e97cb43-1e40-42fc-af47-96ffa39558a1 tempest-VolumesSnapshotTestJSON-1101333329 None] Created volume successfully. Sep 10 19:56:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-13b15fa0-4396-4ccc-9ad5-0c87d5f2b2b7 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "cinder-291fce27-5a34-4ec0-90bc-73bc4d43cecd-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-13b15fa0-4396-4ccc-9ad5-0c87d5f2b2b7 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-291fce27-5a34-4ec0-90bc-73bc4d43cecd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-13b15fa0-4396-4ccc-9ad5-0c87d5f2b2b7 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "cinder-quobyte-291fce27-5a34-4ec0-90bc-73bc4d43cecd" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-13b15fa0-4396-4ccc-9ad5-0c87d5f2b2b7 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-quobyte-291fce27-5a34-4ec0-90bc-73bc4d43cecd" acquired by "delete_volume" :: waited 0.041s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:07 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cda33b1-96d1-48ce-8ec5-a0f86401b544]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:56:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-13b15fa0-4396-4ccc-9ad5-0c87d5f2b2b7 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-291fce27-5a34-4ec0-90bc-73bc4d43cecd {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:07 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-291fce27-5a34-4ec0-90bc-73bc4d43cecd Sep 10 19:56:07 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:07 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-13b15fa0-4396-4ccc-9ad5-0c87d5f2b2b7 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-291fce27-5a34-4ec0-90bc-73bc4d43cecd" returned: 0 in 0.446s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-13b15fa0-4396-4ccc-9ad5-0c87d5f2b2b7 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-291fce27-5a34-4ec0-90bc-73bc4d43cecd {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:07 devstack sudo[101757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-291fce27-5a34-4ec0-90bc-73bc4d43cecd Sep 10 19:56:07 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:08 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-13b15fa0-4396-4ccc-9ad5-0c87d5f2b2b7 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-291fce27-5a34-4ec0-90bc-73bc4d43cecd" returned: 0 in 0.314s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-13b15fa0-4396-4ccc-9ad5-0c87d5f2b2b7 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-quobyte-291fce27-5a34-4ec0-90bc-73bc4d43cecd" released by "delete_volume" :: held 0.808s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-13b15fa0-4396-4ccc-9ad5-0c87d5f2b2b7 tempest-VolumesSnapshotTestJSON-1101333329 None] Created reservations ['13b21d74-ea93-4cfb-8c8e-01d60f580fde', '7ccc7708-ee78-4c48-b447-5b0382e67c76', '282d6932-4d51-4e0d-a269-e9763c7466ca', '91cfa1ae-e281-4563-ab5b-f49c3c52ab31'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-13b15fa0-4396-4ccc-9ad5-0c87d5f2b2b7 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-13b15fa0-4396-4ccc-9ad5-0c87d5f2b2b7 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-13b15fa0-4396-4ccc-9ad5-0c87d5f2b2b7 tempest-VolumesSnapshotTestJSON-1101333329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-13b15fa0-4396-4ccc-9ad5-0c87d5f2b2b7 tempest-VolumesSnapshotTestJSON-1101333329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-13b15fa0-4396-4ccc-9ad5-0c87d5f2b2b7 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-13b15fa0-4396-4ccc-9ad5-0c87d5f2b2b7 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:08 devstack sudo[101760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:56:08 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7b7cbc9f-0ee5-4eba-9c9e-0f7637f45434 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "cinder-9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7b7cbc9f-0ee5-4eba-9c9e-0f7637f45434 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7b7cbc9f-0ee5-4eba-9c9e-0f7637f45434 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "cinder-quobyte-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7b7cbc9f-0ee5-4eba-9c9e-0f7637f45434 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-quobyte-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7b7cbc9f-0ee5-4eba-9c9e-0f7637f45434 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "cinder-quobyte-9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7b7cbc9f-0ee5-4eba-9c9e-0f7637f45434 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-quobyte-9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-7b7cbc9f-0ee5-4eba-9c9e-0f7637f45434 tempest-VolumesSnapshotTestJSON-1101333329 None] Deleting offline snapshot 9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf of volume 60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-7b7cbc9f-0ee5-4eba-9c9e-0f7637f45434 tempest-VolumesSnapshotTestJSON-1101333329 None] snapshot_file for this snap is: volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731.9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 19:56:08 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-13b15fa0-4396-4ccc-9ad5-0c87d5f2b2b7 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.359s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-13b15fa0-4396-4ccc-9ad5-0c87d5f2b2b7 tempest-VolumesSnapshotTestJSON-1101333329 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[965a62ec-000e-4c1c-b88f-899558d46355]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b7cbc9f-0ee5-4eba-9c9e-0f7637f45434 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731.9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:08 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-13b15fa0-4396-4ccc-9ad5-0c87d5f2b2b7 tempest-VolumesSnapshotTestJSON-1101333329 None] Deleted volume successfully. Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-13b15fa0-4396-4ccc-9ad5-0c87d5f2b2b7 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-291fce27-5a34-4ec0-90bc-73bc4d43cecd-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:08 devstack sudo[101763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731.9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf Sep 10 19:56:08 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Flow 'volume_create_manager' (cfbf6a2d-07c6-45e7-833b-9332dece815d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (788c8090-d719-4ae7-8d1b-7d98ad99afab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (788c8090-d719-4ae7-8d1b-7d98ad99afab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-518210321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff31e29-60e6-4f07-ad06-6e42b8caed22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4de6af84f7e04745b9d5ade6e10d0c0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:56:09Z,use_quota=True,user_id='8a21a6b261d44268bd08b61e72e92c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efade8ce-66b0-4a5c-ac56-68704cda6a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efade8ce-66b0-4a5c-ac56-68704cda6a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05333b6e-dcb4-49ce-bf6a-e37f578cba1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05333b6e-dcb4-49ce-bf6a-e37f578cba1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ff31e29-60e6-4f07-ad06-6e42b8caed22', 'volume_name': 'volume-9ff31e29-60e6-4f07-ad06-6e42b8caed22', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d36b7a6-f5e5-4455-af8d-8e42cb76b2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d36b7a6-f5e5-4455-af8d-8e42cb76b2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (332623ca-895c-4cde-853d-e6a996bd33fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:08 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Volume 9ff31e29-60e6-4f07-ad06-6e42b8caed22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ff31e29-60e6-4f07-ad06-6e42b8caed22', 'volume_size': 1} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-518210321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff31e29-60e6-4f07-ad06-6e42b8caed22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4de6af84f7e04745b9d5ade6e10d0c0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:56:09Z,use_quota=True,user_id='8a21a6b261d44268bd08b61e72e92c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Creating volume 9ff31e29-60e6-4f07-ad06-6e42b8caed22 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:56:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:56:09 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:56:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:56:09 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:56:09 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:56:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9ff31e29-60e6-4f07-ad06-6e42b8caed22 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:09 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9ff31e29-60e6-4f07-ad06-6e42b8caed22 1073741824 Sep 10 19:56:09 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:09 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b7cbc9f-0ee5-4eba-9c9e-0f7637f45434 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731.9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf" returned: 0 in 0.429s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:09 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-7b7cbc9f-0ee5-4eba-9c9e-0f7637f45434 tempest-VolumesSnapshotTestJSON-1101333329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:56:09 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d42ae78-9297-4247-b749-38eff980b2f4]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:56:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b7cbc9f-0ee5-4eba-9c9e-0f7637f45434 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:09 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731 Sep 10 19:56:09 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:09 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9ff31e29-60e6-4f07-ad06-6e42b8caed22 1073741824" returned: 0 in 0.518s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9ff31e29-60e6-4f07-ad06-6e42b8caed22 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:09 devstack sudo[101779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9ff31e29-60e6-4f07-ad06-6e42b8caed22 Sep 10 19:56:09 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:09 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b7cbc9f-0ee5-4eba-9c9e-0f7637f45434 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731" returned: 0 in 0.569s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b7cbc9f-0ee5-4eba-9c9e-0f7637f45434 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731.9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:09 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731.9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf Sep 10 19:56:09 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:09 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9ff31e29-60e6-4f07-ad06-6e42b8caed22" returned: 0 in 0.276s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:09 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:56:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:56:09 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (332623ca-895c-4cde-853d-e6a996bd33fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ff31e29-60e6-4f07-ad06-6e42b8caed22', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:09 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eceb428-2032-49ff-a70b-80e0eb8bd3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:09 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Volume volume-9ff31e29-60e6-4f07-ad06-6e42b8caed22 (9ff31e29-60e6-4f07-ad06-6e42b8caed22): created successfully Sep 10 19:56:09 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eceb428-2032-49ff-a70b-80e0eb8bd3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:09 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Flow 'volume_create_manager' (cfbf6a2d-07c6-45e7-833b-9332dece815d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:56:09 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-f958e43e-8b42-4bea-8b48-5b6be56095e0 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Created volume successfully. Sep 10 19:56:10 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b7cbc9f-0ee5-4eba-9c9e-0f7637f45434 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731.9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf" returned: 0 in 0.389s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b7cbc9f-0ee5-4eba-9c9e-0f7637f45434 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731.9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:10 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731.9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf Sep 10 19:56:10 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:10 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b7cbc9f-0ee5-4eba-9c9e-0f7637f45434 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731.9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf" returned: 0 in 0.263s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7b7cbc9f-0ee5-4eba-9c9e-0f7637f45434 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-quobyte-9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf" released by "_delete_snapshot" :: held 1.779s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7b7cbc9f-0ee5-4eba-9c9e-0f7637f45434 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-quobyte-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731" released by "delete_snapshot" :: held 1.839s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:10 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-7b7cbc9f-0ee5-4eba-9c9e-0f7637f45434 tempest-VolumesSnapshotTestJSON-1101333329 None] Created reservations ['af458289-13bd-4153-9a6f-7235c93e1e5e', '32c23a80-9c78-4ebf-90a2-3dbde26eceeb', '8e00e27f-6e96-45c6-99c8-15812a305090', '23bf1eba-d549-4d13-9bbd-060df0da93b7'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:56:10 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-7b7cbc9f-0ee5-4eba-9c9e-0f7637f45434 tempest-VolumesSnapshotTestJSON-1101333329 None] Delete snapshot completed successfully. Sep 10 19:56:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7b7cbc9f-0ee5-4eba-9c9e-0f7637f45434 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-9e8bf706-8cf0-4f4d-97fa-e5ac3e8667bf-delete_snapshot" released by "delete_snapshot" :: held 1.998s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7699f1d7-51b3-4214-bb9c-1fa746634154 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "cinder-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7699f1d7-51b3-4214-bb9c-1fa746634154 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7699f1d7-51b3-4214-bb9c-1fa746634154 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "cinder-quobyte-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7699f1d7-51b3-4214-bb9c-1fa746634154 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-quobyte-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731" acquired by "delete_volume" :: waited 0.029s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:10 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[e753fe74-e7e0-430a-92d2-04d12746c6f3]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:56:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7699f1d7-51b3-4214-bb9c-1fa746634154 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:11 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731 Sep 10 19:56:11 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:11 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7699f1d7-51b3-4214-bb9c-1fa746634154 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731" returned: 0 in 0.418s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7699f1d7-51b3-4214-bb9c-1fa746634154 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:11 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731 Sep 10 19:56:11 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:11 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7699f1d7-51b3-4214-bb9c-1fa746634154 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731" returned: 0 in 0.260s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:11 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7699f1d7-51b3-4214-bb9c-1fa746634154 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-quobyte-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731" released by "delete_volume" :: held 0.774s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:11 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-7699f1d7-51b3-4214-bb9c-1fa746634154 tempest-VolumesSnapshotTestJSON-1101333329 None] Created reservations ['682ebc39-e506-4080-864b-2d2d8e22812b', 'd471aa61-114e-4b09-bd1b-b4dd6e7a69c4', '73d3ab8f-182c-475e-b200-f7131b306abb', '1c14b91f-2a42-4820-bc20-deb223bcc842'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:56:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7699f1d7-51b3-4214-bb9c-1fa746634154 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:56:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7699f1d7-51b3-4214-bb9c-1fa746634154 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:56:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7699f1d7-51b3-4214-bb9c-1fa746634154 tempest-VolumesSnapshotTestJSON-1101333329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:56:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7699f1d7-51b3-4214-bb9c-1fa746634154 tempest-VolumesSnapshotTestJSON-1101333329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:56:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7699f1d7-51b3-4214-bb9c-1fa746634154 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:56:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7699f1d7-51b3-4214-bb9c-1fa746634154 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:11 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:56:11 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-1938749f-c092-4e90-8029-325883a9268d req-c821b091-21c7-4131-9503-17d8c53715e8 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:56:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-1938749f-c092-4e90-8029-325883a9268d req-c821b091-21c7-4131-9503-17d8c53715e8 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:56:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-1938749f-c092-4e90-8029-325883a9268d req-c821b091-21c7-4131-9503-17d8c53715e8 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:56:12 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7699f1d7-51b3-4214-bb9c-1fa746634154 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.372s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:12 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-7699f1d7-51b3-4214-bb9c-1fa746634154 tempest-VolumesSnapshotTestJSON-1101333329 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:56:12 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-7699f1d7-51b3-4214-bb9c-1fa746634154 tempest-VolumesSnapshotTestJSON-1101333329 None] Deleted volume successfully. Sep 10 19:56:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-1938749f-c092-4e90-8029-325883a9268d req-c821b091-21c7-4131-9503-17d8c53715e8 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3', 'name': 'volume-9ff31e29-60e6-4f07-ad06-6e42b8caed22', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32955d15-421a-4d97-b381-6543145c3cca', 'enforce_multipath': True} {{(pid=88093) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 19:56:12 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7699f1d7-51b3-4214-bb9c-1fa746634154 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-60ddc4a7-7fd7-4ea2-8f4c-20589c9b0731-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:12 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-1938749f-c092-4e90-8029-325883a9268d req-c821b091-21c7-4131-9503-17d8c53715e8 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] attachment_update completed successfully. Sep 10 19:56:12 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:56:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] Flow 'volume_create_manager' (d4f2d02a-c31f-4e26-b07d-d4cf07349f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:56:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4bde401-2cc4-4f06-88cc-f266d11fc2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4bde401-2cc4-4f06-88cc-f266d11fc2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1498705003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51593618-fbba-41b5-a868-68b8a1ea0bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64eea74213bd4a07852ecad5c1ecb9e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:56:13Z,use_quota=True,user_id='87f350fadbbb4ceb86ae537b7968333a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c43d80fe-fc72-43ea-8c84-daeb44c7ae21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c43d80fe-fc72-43ea-8c84-daeb44c7ae21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7546f38e-c991-4059-b2be-1354836f0a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7546f38e-c991-4059-b2be-1354836f0a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51593618-fbba-41b5-a868-68b8a1ea0bb9', 'volume_name': 'volume-51593618-fbba-41b5-a868-68b8a1ea0bb9', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e438e682-4d93-43be-b403-079c5b66a6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e438e682-4d93-43be-b403-079c5b66a6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf794f5-4376-478c-b7c3-f1b78dd37424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:12 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] Volume 51593618-fbba-41b5-a868-68b8a1ea0bb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51593618-fbba-41b5-a868-68b8a1ea0bb9', 'volume_size': 1} Sep 10 19:56:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:56:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:56:12 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1498705003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51593618-fbba-41b5-a868-68b8a1ea0bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64eea74213bd4a07852ecad5c1ecb9e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:56:13Z,use_quota=True,user_id='87f350fadbbb4ceb86ae537b7968333a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:56:12 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] Creating volume 51593618-fbba-41b5-a868-68b8a1ea0bb9 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:56:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:56:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:56:12 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:56:12 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:56:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:56:12 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:56:12 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:56:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:12 devstack sudo[102195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9 1073741824 Sep 10 19:56:12 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:13 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9 1073741824" returned: 0 in 0.660s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:13 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9 Sep 10 19:56:13 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:13 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9" returned: 0 in 0.244s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:13 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:56:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:56:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf794f5-4376-478c-b7c3-f1b78dd37424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51593618-fbba-41b5-a868-68b8a1ea0bb9', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d003464-46ca-4a2b-968b-f89ffa1fe541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:13 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] Volume volume-51593618-fbba-41b5-a868-68b8a1ea0bb9 (51593618-fbba-41b5-a868-68b8a1ea0bb9): created successfully Sep 10 19:56:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d003464-46ca-4a2b-968b-f89ffa1fe541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] Flow 'volume_create_manager' (d4f2d02a-c31f-4e26-b07d-d4cf07349f7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:56:13 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-29d450f4-69d9-4dc2-ac97-5563bbfa64d4 tempest-VolumesSnapshotTestJSON-1101333329 None] Created volume successfully. Sep 10 19:56:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3b21af4c-9564-45c5-85d5-646e2de9a192 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:56:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3b21af4c-9564-45c5-85d5-646e2de9a192 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:56:15 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-3b21af4c-9564-45c5-85d5-646e2de9a192 tempest-VolumesSnapshotTestJSON-1101333329 None] Creating offline snapshot d23d3c60-4a57-4e25-8d12-89d899267933 of volume 51593618-fbba-41b5-a868-68b8a1ea0bb9 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 19:56:15 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[d863ca2a-f5fb-4739-aefa-acd327ce1e21]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:56:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3b21af4c-9564-45c5-85d5-646e2de9a192 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:15 devstack sudo[102203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9 Sep 10 19:56:15 devstack sudo[102203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:15 devstack sudo[102203]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3b21af4c-9564-45c5-85d5-646e2de9a192 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9" returned: 0 in 0.577s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3b21af4c-9564-45c5-85d5-646e2de9a192 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9.d23d3c60-4a57-4e25-8d12-89d899267933 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:15 devstack sudo[102210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9.d23d3c60-4a57-4e25-8d12-89d899267933 1G Sep 10 19:56:15 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:15 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-e3cc0a0b-e4de-4315-8e99-702698f7c2b4 req-3ef77daf-bd94-40d3-b5d9-56e7c882e73b tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Terminate volume connection completed successfully. Sep 10 19:56:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-e3cc0a0b-e4de-4315-8e99-702698f7c2b4 req-3ef77daf-bd94-40d3-b5d9-56e7c882e73b tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Deleting attachment 32955d15-421a-4d97-b381-6543145c3cca. {{(pid=88093) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 19:56:16 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3b21af4c-9564-45c5-85d5-646e2de9a192 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9.d23d3c60-4a57-4e25-8d12-89d899267933 1G" returned: 0 in 0.631s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3b21af4c-9564-45c5-85d5-646e2de9a192 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51593618-fbba-41b5-a868-68b8a1ea0bb9 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9.d23d3c60-4a57-4e25-8d12-89d899267933 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:16 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51593618-fbba-41b5-a868-68b8a1ea0bb9 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9.d23d3c60-4a57-4e25-8d12-89d899267933 Sep 10 19:56:16 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-266eb0c9-54a3-4cac-9975-a3198d790c71 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Acquiring lock "cinder-9ff31e29-60e6-4f07-ad06-6e42b8caed22-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-266eb0c9-54a3-4cac-9975-a3198d790c71 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Lock "cinder-9ff31e29-60e6-4f07-ad06-6e42b8caed22-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-266eb0c9-54a3-4cac-9975-a3198d790c71 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Acquiring lock "cinder-quobyte-9ff31e29-60e6-4f07-ad06-6e42b8caed22" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-266eb0c9-54a3-4cac-9975-a3198d790c71 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Lock "cinder-quobyte-9ff31e29-60e6-4f07-ad06-6e42b8caed22" acquired by "delete_volume" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:16 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3b21af4c-9564-45c5-85d5-646e2de9a192 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51593618-fbba-41b5-a868-68b8a1ea0bb9 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9.d23d3c60-4a57-4e25-8d12-89d899267933" returned: 0 in 0.441s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:16 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-3b21af4c-9564-45c5-85d5-646e2de9a192 tempest-VolumesSnapshotTestJSON-1101333329 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9.d23d3c60-4a57-4e25-8d12-89d899267933 is being set with open permissions: ugo+rw Sep 10 19:56:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3b21af4c-9564-45c5-85d5-646e2de9a192 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9.d23d3c60-4a57-4e25-8d12-89d899267933 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:16 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a57beb2-45ec-474c-a859-f73c6afbb7af]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:56:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-266eb0c9-54a3-4cac-9975-a3198d790c71 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9ff31e29-60e6-4f07-ad06-6e42b8caed22 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:16 devstack sudo[102248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9.d23d3c60-4a57-4e25-8d12-89d899267933 Sep 10 19:56:16 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:17 devstack sudo[102249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9ff31e29-60e6-4f07-ad06-6e42b8caed22 Sep 10 19:56:17 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:17 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3b21af4c-9564-45c5-85d5-646e2de9a192 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9.d23d3c60-4a57-4e25-8d12-89d899267933" returned: 0 in 0.309s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3b21af4c-9564-45c5-85d5-646e2de9a192 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:17 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9.info Sep 10 19:56:17 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:17 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-266eb0c9-54a3-4cac-9975-a3198d790c71 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9ff31e29-60e6-4f07-ad06-6e42b8caed22" returned: 0 in 0.509s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-266eb0c9-54a3-4cac-9975-a3198d790c71 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9ff31e29-60e6-4f07-ad06-6e42b8caed22 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:17 devstack sudo[102258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9ff31e29-60e6-4f07-ad06-6e42b8caed22 Sep 10 19:56:17 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:17 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3b21af4c-9564-45c5-85d5-646e2de9a192 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9.info" returned: 0 in 0.323s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:17 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-3b21af4c-9564-45c5-85d5-646e2de9a192 tempest-VolumesSnapshotTestJSON-1101333329 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9.info is being set with open permissions: ugo+rw Sep 10 19:56:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3b21af4c-9564-45c5-85d5-646e2de9a192 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:17 devstack sudo[102261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9.info Sep 10 19:56:17 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:17 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-266eb0c9-54a3-4cac-9975-a3198d790c71 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9ff31e29-60e6-4f07-ad06-6e42b8caed22" returned: 0 in 0.404s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:17 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-266eb0c9-54a3-4cac-9975-a3198d790c71 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Lock "cinder-quobyte-9ff31e29-60e6-4f07-ad06-6e42b8caed22" released by "delete_volume" :: held 0.988s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:17 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-266eb0c9-54a3-4cac-9975-a3198d790c71 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Created reservations ['2516c8db-0eed-46b0-8787-03155fff30fd', 'c05baa3d-16b0-4497-978a-9bafa8411a9f', 'a837716b-516e-4ea6-923c-6edf5580378d', '022d6cf3-1944-450a-b857-907b0f62a984'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:56:17 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3b21af4c-9564-45c5-85d5-646e2de9a192 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9.info" returned: 0 in 0.464s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3b21af4c-9564-45c5-85d5-646e2de9a192 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.890s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:56:18 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-3b21af4c-9564-45c5-85d5-646e2de9a192 tempest-VolumesSnapshotTestJSON-1101333329 None] Create snapshot completed successfully Sep 10 19:56:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-266eb0c9-54a3-4cac-9975-a3198d790c71 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:56:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-266eb0c9-54a3-4cac-9975-a3198d790c71 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:56:18 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-266eb0c9-54a3-4cac-9975-a3198d790c71 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:56:18 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-266eb0c9-54a3-4cac-9975-a3198d790c71 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:56:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-266eb0c9-54a3-4cac-9975-a3198d790c71 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:56:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-266eb0c9-54a3-4cac-9975-a3198d790c71 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:18 devstack sudo[102266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:56:18 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:18 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-266eb0c9-54a3-4cac-9975-a3198d790c71 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.293s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:18 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-266eb0c9-54a3-4cac-9975-a3198d790c71 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:56:18 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-266eb0c9-54a3-4cac-9975-a3198d790c71 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Deleted volume successfully. Sep 10 19:56:18 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-266eb0c9-54a3-4cac-9975-a3198d790c71 tempest-TestServerVolumeAttachScenarioOldVersion-584305992 None] Lock "cinder-9ff31e29-60e6-4f07-ad06-6e42b8caed22-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:18 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:56:18 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Flow 'volume_create_manager' (b5f537bf-04a4-47be-a972-c41c43cb67b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:56:18 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (561f9a92-c462-4862-9637-4b162e97848d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:18 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (561f9a92-c462-4862-9637-4b162e97848d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-736947941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6558b4f0-d47b-4290-b73b-b7c6862559d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64eea74213bd4a07852ecad5c1ecb9e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d23d3c60-4a57-4e25-8d12-89d899267933,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:56:19Z,use_quota=True,user_id='87f350fadbbb4ceb86ae537b7968333a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:18 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80567f9c-d5d8-440f-8dd9-12284ba787ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:18 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80567f9c-d5d8-440f-8dd9-12284ba787ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:18 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89349c24-5875-4899-9ac9-704b0b03cbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89349c24-5875-4899-9ac9-704b0b03cbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6558b4f0-d47b-4290-b73b-b7c6862559d9', 'volume_name': 'volume-6558b4f0-d47b-4290-b73b-b7c6862559d9', 'volume_size': 1, 'snapshot_id': 'd23d3c60-4a57-4e25-8d12-89d899267933'}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d1c602c-5e7d-4680-aa2e-66fcba60be07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d1c602c-5e7d-4680-aa2e-66fcba60be07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd726597-bfbb-4368-9950-85a401b16df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:19 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Volume 6558b4f0-d47b-4290-b73b-b7c6862559d9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6558b4f0-d47b-4290-b73b-b7c6862559d9', 'volume_size': 1, 'snapshot_id': 'd23d3c60-4a57-4e25-8d12-89d899267933'} Sep 10 19:56:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:56:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:56:19 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "cinder-quobyte-d23d3c60-4a57-4e25-8d12-89d899267933-6558b4f0-d47b-4290-b73b-b7c6862559d9" by "_create_volume_from_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:19 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-quobyte-d23d3c60-4a57-4e25-8d12-89d899267933-6558b4f0-d47b-4290-b73b-b7c6862559d9" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:19 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Creating volume 6558b4f0-d47b-4290-b73b-b7c6862559d9 from snapshot d23d3c60-4a57-4e25-8d12-89d899267933 {{(pid=88093) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 10 19:56:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:56:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:56:19 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:56:19 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:56:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:56:19 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:56:19 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "cinder-quobyte-6558b4f0-d47b-4290-b73b-b7c6862559d9" by "_copy_volume_from_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:19 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-quobyte-6558b4f0-d47b-4290-b73b-b7c6862559d9" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:19 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] snapshot: d23d3c60-4a57-4e25-8d12-89d899267933, volume: 6558b4f0-d47b-4290-b73b-b7c6862559d9, {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 19:56:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:56:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:56:19 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:56:19 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:56:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:56:19 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb561331-6bbd-4c67-9c69-592fd86face3]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:56:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9.d23d3c60-4a57-4e25-8d12-89d899267933 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:19 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9.d23d3c60-4a57-4e25-8d12-89d899267933 Sep 10 19:56:19 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:19 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9.d23d3c60-4a57-4e25-8d12-89d899267933" returned: 0 in 0.579s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:19 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51593618-fbba-41b5-a868-68b8a1ea0bb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:56:19 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a9df36-42e9-4a88-9ad1-82b1e1354a3b]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:56:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:19 devstack sudo[102293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9 Sep 10 19:56:19 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:20 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9" returned: 0 in 0.531s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:20 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9 {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 19:56:20 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Creating direct copy from snapshot {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 19:56:20 devstack cinder-volume[88093]: DEBUG cinder.utils [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Path /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6558b4f0-d47b-4290-b73b-b7c6862559d9 not found in is_blk_device check {{(pid=88093) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 19:56:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6558b4f0-d47b-4290-b73b-b7c6862559d9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:20 devstack sudo[102303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6558b4f0-d47b-4290-b73b-b7c6862559d9 Sep 10 19:56:20 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:26 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6558b4f0-d47b-4290-b73b-b7c6862559d9" returned: 0 in 5.753s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:26 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Image conversion details: src /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9, size 1024.00 MB, duration 5.75 sec, destination /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6558b4f0-d47b-4290-b73b-b7c6862559d9 {{(pid=88093) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 19:56:26 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Converted 1024.00 MB image at 177.95 MB/s Sep 10 19:56:26 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6558b4f0-d47b-4290-b73b-b7c6862559d9 is being set with open permissions: ugo+rw Sep 10 19:56:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6558b4f0-d47b-4290-b73b-b7c6862559d9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:26 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6558b4f0-d47b-4290-b73b-b7c6862559d9 Sep 10 19:56:26 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:26 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6558b4f0-d47b-4290-b73b-b7c6862559d9" returned: 0 in 0.277s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:26 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-quobyte-6558b4f0-d47b-4290-b73b-b7c6862559d9" released by "_copy_volume_from_snapshot" :: held 7.249s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:26 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-quobyte-d23d3c60-4a57-4e25-8d12-89d899267933-6558b4f0-d47b-4290-b73b-b7c6862559d9" released by "_create_volume_from_snapshot" :: held 7.322s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.343s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:56:26 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd726597-bfbb-4368-9950-85a401b16df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6558b4f0-d47b-4290-b73b-b7c6862559d9', 'volume_size': 1, 'snapshot_id': 'd23d3c60-4a57-4e25-8d12-89d899267933'}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:26 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d3624df-a80f-483d-aa3e-7f0bec353336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:26 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Volume volume-6558b4f0-d47b-4290-b73b-b7c6862559d9 (6558b4f0-d47b-4290-b73b-b7c6862559d9): created successfully Sep 10 19:56:26 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d3624df-a80f-483d-aa3e-7f0bec353336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:26 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Flow 'volume_create_manager' (b5f537bf-04a4-47be-a972-c41c43cb67b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:56:26 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-b6001c24-72f8-4190-83b9-6625a1a68a42 tempest-VolumesSnapshotTestJSON-1101333329 None] Created volume successfully. Sep 10 19:56:27 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-80880424-093c-499f-9f6f-0d5a414b47cf tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "cinder-6558b4f0-d47b-4290-b73b-b7c6862559d9-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:27 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-80880424-093c-499f-9f6f-0d5a414b47cf tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-6558b4f0-d47b-4290-b73b-b7c6862559d9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:27 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-80880424-093c-499f-9f6f-0d5a414b47cf tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "cinder-quobyte-6558b4f0-d47b-4290-b73b-b7c6862559d9" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:27 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-80880424-093c-499f-9f6f-0d5a414b47cf tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-quobyte-6558b4f0-d47b-4290-b73b-b7c6862559d9" acquired by "delete_volume" :: waited 0.015s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:27 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0a7a2a-e144-4260-9041-e74a28b87272]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:56:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-80880424-093c-499f-9f6f-0d5a414b47cf tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6558b4f0-d47b-4290-b73b-b7c6862559d9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:27 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6558b4f0-d47b-4290-b73b-b7c6862559d9 Sep 10 19:56:27 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:27 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-80880424-093c-499f-9f6f-0d5a414b47cf tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6558b4f0-d47b-4290-b73b-b7c6862559d9" returned: 0 in 0.421s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-80880424-093c-499f-9f6f-0d5a414b47cf tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6558b4f0-d47b-4290-b73b-b7c6862559d9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:27 devstack sudo[102331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6558b4f0-d47b-4290-b73b-b7c6862559d9 Sep 10 19:56:27 devstack sudo[102331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:27 devstack sudo[102331]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-80880424-093c-499f-9f6f-0d5a414b47cf tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6558b4f0-d47b-4290-b73b-b7c6862559d9" returned: 0 in 0.260s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:27 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-80880424-093c-499f-9f6f-0d5a414b47cf tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-quobyte-6558b4f0-d47b-4290-b73b-b7c6862559d9" released by "delete_volume" :: held 0.750s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:27 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-80880424-093c-499f-9f6f-0d5a414b47cf tempest-VolumesSnapshotTestJSON-1101333329 None] Created reservations ['38c5525f-9904-40e3-ae73-5828e59f4554', 'bbf9345e-473c-404d-9d78-e8ea571932b5', '796b7b90-1115-4c7a-bf12-7d480334f825', '0e864857-06ca-4594-b5a4-d9c042c4297e'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:56:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-80880424-093c-499f-9f6f-0d5a414b47cf tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:56:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-80880424-093c-499f-9f6f-0d5a414b47cf tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:56:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-80880424-093c-499f-9f6f-0d5a414b47cf tempest-VolumesSnapshotTestJSON-1101333329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:56:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-80880424-093c-499f-9f6f-0d5a414b47cf tempest-VolumesSnapshotTestJSON-1101333329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:56:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-80880424-093c-499f-9f6f-0d5a414b47cf tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:56:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-80880424-093c-499f-9f6f-0d5a414b47cf tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:28 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:56:28 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:28 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-34460a1b-7f5a-4743-a5e9-ca8d6f489411 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "cinder-d23d3c60-4a57-4e25-8d12-89d899267933-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:28 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:28 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-34460a1b-7f5a-4743-a5e9-ca8d6f489411 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-d23d3c60-4a57-4e25-8d12-89d899267933-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:28 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-34460a1b-7f5a-4743-a5e9-ca8d6f489411 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "cinder-quobyte-51593618-fbba-41b5-a868-68b8a1ea0bb9" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-80880424-093c-499f-9f6f-0d5a414b47cf tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.363s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:28 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-80880424-093c-499f-9f6f-0d5a414b47cf tempest-VolumesSnapshotTestJSON-1101333329 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:56:28 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-80880424-093c-499f-9f6f-0d5a414b47cf tempest-VolumesSnapshotTestJSON-1101333329 None] Deleted volume successfully. Sep 10 19:56:28 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-34460a1b-7f5a-4743-a5e9-ca8d6f489411 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-quobyte-51593618-fbba-41b5-a868-68b8a1ea0bb9" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:28 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-34460a1b-7f5a-4743-a5e9-ca8d6f489411 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "cinder-quobyte-d23d3c60-4a57-4e25-8d12-89d899267933" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:28 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-34460a1b-7f5a-4743-a5e9-ca8d6f489411 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-quobyte-d23d3c60-4a57-4e25-8d12-89d899267933" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-34460a1b-7f5a-4743-a5e9-ca8d6f489411 tempest-VolumesSnapshotTestJSON-1101333329 None] Deleting offline snapshot d23d3c60-4a57-4e25-8d12-89d899267933 of volume 51593618-fbba-41b5-a868-68b8a1ea0bb9 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 19:56:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-34460a1b-7f5a-4743-a5e9-ca8d6f489411 tempest-VolumesSnapshotTestJSON-1101333329 None] snapshot_file for this snap is: volume-51593618-fbba-41b5-a868-68b8a1ea0bb9.d23d3c60-4a57-4e25-8d12-89d899267933 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 19:56:28 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8a5724-dbb5-407e-a280-c1db267619ad]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:56:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-34460a1b-7f5a-4743-a5e9-ca8d6f489411 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9.d23d3c60-4a57-4e25-8d12-89d899267933 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:28 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-80880424-093c-499f-9f6f-0d5a414b47cf tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-6558b4f0-d47b-4290-b73b-b7c6862559d9-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:28 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9.d23d3c60-4a57-4e25-8d12-89d899267933 Sep 10 19:56:28 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:28 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-34460a1b-7f5a-4743-a5e9-ca8d6f489411 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9.d23d3c60-4a57-4e25-8d12-89d899267933" returned: 0 in 0.427s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-34460a1b-7f5a-4743-a5e9-ca8d6f489411 tempest-VolumesSnapshotTestJSON-1101333329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51593618-fbba-41b5-a868-68b8a1ea0bb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:56:28 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a39bd1a-abaa-4e1b-bc66-1486aae1c2f7]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:56:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-34460a1b-7f5a-4743-a5e9-ca8d6f489411 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:29 devstack sudo[102342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9 Sep 10 19:56:29 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:29 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-34460a1b-7f5a-4743-a5e9-ca8d6f489411 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9" returned: 0 in 0.621s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-34460a1b-7f5a-4743-a5e9-ca8d6f489411 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9.d23d3c60-4a57-4e25-8d12-89d899267933 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:29 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9.d23d3c60-4a57-4e25-8d12-89d899267933 Sep 10 19:56:29 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:30 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-34460a1b-7f5a-4743-a5e9-ca8d6f489411 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9.d23d3c60-4a57-4e25-8d12-89d899267933" returned: 0 in 0.427s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-34460a1b-7f5a-4743-a5e9-ca8d6f489411 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9.d23d3c60-4a57-4e25-8d12-89d899267933 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:30 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9.d23d3c60-4a57-4e25-8d12-89d899267933 Sep 10 19:56:30 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:30 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-34460a1b-7f5a-4743-a5e9-ca8d6f489411 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9.d23d3c60-4a57-4e25-8d12-89d899267933" returned: 0 in 0.265s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:30 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-34460a1b-7f5a-4743-a5e9-ca8d6f489411 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-quobyte-d23d3c60-4a57-4e25-8d12-89d899267933" released by "_delete_snapshot" :: held 1.894s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:30 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-34460a1b-7f5a-4743-a5e9-ca8d6f489411 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-quobyte-51593618-fbba-41b5-a868-68b8a1ea0bb9" released by "delete_snapshot" :: held 1.927s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:30 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-34460a1b-7f5a-4743-a5e9-ca8d6f489411 tempest-VolumesSnapshotTestJSON-1101333329 None] Created reservations ['bf555abf-5e52-4abd-88e8-d4e8b953f3a5', '1c240534-00d4-4ec6-b958-1578c6024212', '8d2f17c1-dc23-46bd-a4f7-d0048138b326', '2695e094-04cd-47ec-9d28-bf2fd562544a'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:56:30 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-34460a1b-7f5a-4743-a5e9-ca8d6f489411 tempest-VolumesSnapshotTestJSON-1101333329 None] Delete snapshot completed successfully. Sep 10 19:56:30 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-34460a1b-7f5a-4743-a5e9-ca8d6f489411 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-d23d3c60-4a57-4e25-8d12-89d899267933-delete_snapshot" released by "delete_snapshot" :: held 2.167s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:30 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-892f9800-96c3-4519-9a8e-45f17fb44b3b tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "cinder-51593618-fbba-41b5-a868-68b8a1ea0bb9-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:30 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-892f9800-96c3-4519-9a8e-45f17fb44b3b tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-51593618-fbba-41b5-a868-68b8a1ea0bb9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:30 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-892f9800-96c3-4519-9a8e-45f17fb44b3b tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "cinder-quobyte-51593618-fbba-41b5-a868-68b8a1ea0bb9" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:30 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-892f9800-96c3-4519-9a8e-45f17fb44b3b tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-quobyte-51593618-fbba-41b5-a868-68b8a1ea0bb9" acquired by "delete_volume" :: waited 0.023s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:30 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c83a885-abac-4b00-ade9-f78ed705e8dc]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:56:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-892f9800-96c3-4519-9a8e-45f17fb44b3b tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:31 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9 Sep 10 19:56:31 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:31 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-892f9800-96c3-4519-9a8e-45f17fb44b3b tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9" returned: 0 in 0.453s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-892f9800-96c3-4519-9a8e-45f17fb44b3b tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:31 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9 Sep 10 19:56:31 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:31 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-892f9800-96c3-4519-9a8e-45f17fb44b3b tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-51593618-fbba-41b5-a868-68b8a1ea0bb9" returned: 0 in 0.328s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:31 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-892f9800-96c3-4519-9a8e-45f17fb44b3b tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-quobyte-51593618-fbba-41b5-a868-68b8a1ea0bb9" released by "delete_volume" :: held 0.868s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:31 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-892f9800-96c3-4519-9a8e-45f17fb44b3b tempest-VolumesSnapshotTestJSON-1101333329 None] Created reservations ['6eca38fa-61c3-4f2d-9e60-aee22c13018c', '4c1c7b3a-1ef4-4c94-b28d-7a265a4fc2ab', 'cd775b71-2c2d-4d5a-a480-e89335fe38e3', 'bf54602f-ed21-496e-afdc-53adb6d9dee4'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:56:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-892f9800-96c3-4519-9a8e-45f17fb44b3b tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:56:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-892f9800-96c3-4519-9a8e-45f17fb44b3b tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:56:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-892f9800-96c3-4519-9a8e-45f17fb44b3b tempest-VolumesSnapshotTestJSON-1101333329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:56:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-892f9800-96c3-4519-9a8e-45f17fb44b3b tempest-VolumesSnapshotTestJSON-1101333329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:56:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-892f9800-96c3-4519-9a8e-45f17fb44b3b tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:56:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-892f9800-96c3-4519-9a8e-45f17fb44b3b tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:31 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:56:31 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:32 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f3b3654c-226a-4e03-a41f-8bd381e6cdd8 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "cinder-e9c98e22-4f75-4eef-b06c-ab961bab6179-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:32 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f3b3654c-226a-4e03-a41f-8bd381e6cdd8 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-e9c98e22-4f75-4eef-b06c-ab961bab6179-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:32 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-892f9800-96c3-4519-9a8e-45f17fb44b3b tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.385s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:32 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-892f9800-96c3-4519-9a8e-45f17fb44b3b tempest-VolumesSnapshotTestJSON-1101333329 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:56:32 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-892f9800-96c3-4519-9a8e-45f17fb44b3b tempest-VolumesSnapshotTestJSON-1101333329 None] Deleted volume successfully. Sep 10 19:56:32 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f3b3654c-226a-4e03-a41f-8bd381e6cdd8 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "cinder-quobyte-e9c98e22-4f75-4eef-b06c-ab961bab6179" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:32 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-892f9800-96c3-4519-9a8e-45f17fb44b3b tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-51593618-fbba-41b5-a868-68b8a1ea0bb9-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:32 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f3b3654c-226a-4e03-a41f-8bd381e6cdd8 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-quobyte-e9c98e22-4f75-4eef-b06c-ab961bab6179" acquired by "delete_volume" :: waited 0.028s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:32 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2926b8c-22e0-47b4-9937-31e44011f80e]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:56:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f3b3654c-226a-4e03-a41f-8bd381e6cdd8 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:32 devstack sudo[102407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179 Sep 10 19:56:32 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:32 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f3b3654c-226a-4e03-a41f-8bd381e6cdd8 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179" returned: 0 in 0.435s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f3b3654c-226a-4e03-a41f-8bd381e6cdd8 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:32 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179 Sep 10 19:56:32 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:33 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f3b3654c-226a-4e03-a41f-8bd381e6cdd8 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e9c98e22-4f75-4eef-b06c-ab961bab6179" returned: 0 in 0.319s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:33 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f3b3654c-226a-4e03-a41f-8bd381e6cdd8 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-quobyte-e9c98e22-4f75-4eef-b06c-ab961bab6179" released by "delete_volume" :: held 0.859s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:33 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-f3b3654c-226a-4e03-a41f-8bd381e6cdd8 tempest-VolumesSnapshotTestJSON-1101333329 None] Created reservations ['9d049631-af0a-4cc9-bc18-df03f2d401b0', '25eb3949-ed4b-40da-ad44-7d6dfb11d3b1', '75a47e77-cd10-4555-a887-9609e4806d7f', '06e5786d-3041-4359-9204-98f5a933d56b'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:56:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f3b3654c-226a-4e03-a41f-8bd381e6cdd8 tempest-VolumesSnapshotTestJSON-1101333329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:56:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f3b3654c-226a-4e03-a41f-8bd381e6cdd8 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:56:33 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f3b3654c-226a-4e03-a41f-8bd381e6cdd8 tempest-VolumesSnapshotTestJSON-1101333329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:56:33 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f3b3654c-226a-4e03-a41f-8bd381e6cdd8 tempest-VolumesSnapshotTestJSON-1101333329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:56:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f3b3654c-226a-4e03-a41f-8bd381e6cdd8 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:56:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f3b3654c-226a-4e03-a41f-8bd381e6cdd8 tempest-VolumesSnapshotTestJSON-1101333329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:33 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:56:33 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:33 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f3b3654c-226a-4e03-a41f-8bd381e6cdd8 tempest-VolumesSnapshotTestJSON-1101333329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.323s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:33 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-f3b3654c-226a-4e03-a41f-8bd381e6cdd8 tempest-VolumesSnapshotTestJSON-1101333329 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:56:33 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-f3b3654c-226a-4e03-a41f-8bd381e6cdd8 tempest-VolumesSnapshotTestJSON-1101333329 None] Deleted volume successfully. Sep 10 19:56:33 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f3b3654c-226a-4e03-a41f-8bd381e6cdd8 tempest-VolumesSnapshotTestJSON-1101333329 None] Lock "cinder-e9c98e22-4f75-4eef-b06c-ab961bab6179-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:41 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:UPDATE=122,cinder:SELECT=101,cinder:INSERT=31,cinder:DELETE=8 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:56:41 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=113,cinder:UPDATE=110,cinder:DELETE=11,cinder:INSERT=24 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:56:45 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:56:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] Flow 'volume_create_manager' (ee725b54-9659-45e7-bfd4-15b7d201b5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:56:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33193331-7ce0-4d4b-bfb3-77646a988a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33193331-7ce0-4d4b-bfb3-77646a988a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-692640553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69c2b3db-608b-4817-9709-d69b4e4bcb0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9728737eca423ba60791a04cbe1922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:56:45Z,use_quota=True,user_id='2a92e5c09b99490e8657883518873177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24a8ce25-e366-4d1e-8a98-e3611721e774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24a8ce25-e366-4d1e-8a98-e3611721e774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed328e5c-0e6e-40e6-9373-fb10f2a500db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed328e5c-0e6e-40e6-9373-fb10f2a500db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69c2b3db-608b-4817-9709-d69b4e4bcb0e', 'volume_name': 'volume-69c2b3db-608b-4817-9709-d69b4e4bcb0e', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4a6fac9-38a7-4f02-93e1-c794d15a5040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4a6fac9-38a7-4f02-93e1-c794d15a5040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (273c61f6-be4a-4990-9235-2618346672e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:45 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] Volume 69c2b3db-608b-4817-9709-d69b4e4bcb0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69c2b3db-608b-4817-9709-d69b4e4bcb0e', 'volume_size': 1} Sep 10 19:56:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:56:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:56:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-692640553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69c2b3db-608b-4817-9709-d69b4e4bcb0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9728737eca423ba60791a04cbe1922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:56:45Z,use_quota=True,user_id='2a92e5c09b99490e8657883518873177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:56:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] Creating volume 69c2b3db-608b-4817-9709-d69b4e4bcb0e {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:56:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:56:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:56:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:56:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:56:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:56:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:56:45 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:56:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-69c2b3db-608b-4817-9709-d69b4e4bcb0e 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:45 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-69c2b3db-608b-4817-9709-d69b4e4bcb0e 1073741824 Sep 10 19:56:45 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:46 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-69c2b3db-608b-4817-9709-d69b4e4bcb0e 1073741824" returned: 0 in 0.693s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-69c2b3db-608b-4817-9709-d69b4e4bcb0e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:46 devstack sudo[102519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-69c2b3db-608b-4817-9709-d69b4e4bcb0e Sep 10 19:56:46 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:46 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-69c2b3db-608b-4817-9709-d69b4e4bcb0e" returned: 0 in 0.340s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:46 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:56:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:56:46 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (273c61f6-be4a-4990-9235-2618346672e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69c2b3db-608b-4817-9709-d69b4e4bcb0e', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:46 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a32c09-cf0a-4547-9a21-20a620e20614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:46 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] Volume volume-69c2b3db-608b-4817-9709-d69b4e4bcb0e (69c2b3db-608b-4817-9709-d69b4e4bcb0e): created successfully Sep 10 19:56:46 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a32c09-cf0a-4547-9a21-20a620e20614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:46 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] Flow 'volume_create_manager' (ee725b54-9659-45e7-bfd4-15b7d201b5ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:56:46 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-34c41953-0861-4220-a5e0-a06eaa4624e8 tempest-VolumesActionsTest-896200989 None] Created volume successfully. Sep 10 19:56:47 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:56:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Flow 'volume_create_manager' (8e776ef4-2979-4059-823c-17b252ce318a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:56:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319f80c9-590c-48ba-a09e-2e019a4b264b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319f80c9-590c-48ba-a09e-2e019a4b264b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-862335581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7f7481d-3a4c-4c3e-a90e-96f3d9414046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30be6c82225b4107824dcc1968b038c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:56:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:56:47Z,use_quota=True,user_id='9f6f45942b4b4226979fe61e7026aeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80c2d5a0-c4ee-478a-8fd4-bcd16f68d009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80c2d5a0-c4ee-478a-8fd4-bcd16f68d009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e36b7dee-c636-4489-8d11-3db6665ba3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e36b7dee-c636-4489-8d11-3db6665ba3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7f7481d-3a4c-4c3e-a90e-96f3d9414046', 'volume_name': 'volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046', 'volume_size': 2}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208686bd-e0cd-41b3-b0aa-4f1357159003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208686bd-e0cd-41b3-b0aa-4f1357159003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d25f9d4-cf71-4908-bce5-b9b23461b34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:47 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Volume c7f7481d-3a4c-4c3e-a90e-96f3d9414046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046', 'volume_size': 2} Sep 10 19:56:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:56:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:56:47 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-862335581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7f7481d-3a4c-4c3e-a90e-96f3d9414046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30be6c82225b4107824dcc1968b038c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:56:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:56:47Z,use_quota=True,user_id='9f6f45942b4b4226979fe61e7026aeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:56:47 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Creating volume c7f7481d-3a4c-4c3e-a90e-96f3d9414046 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:56:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:56:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:56:47 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:56:47 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:56:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:56:47 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:56:47 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:56:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046 2147483648 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:47 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046 2147483648 Sep 10 19:56:47 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:47 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-15024877-a144-44ca-9911-360b44ea2aad tempest-VolumesActionsTest-896200989 None] Acquiring lock "cinder-69c2b3db-608b-4817-9709-d69b4e4bcb0e" by "attach_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:47 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-15024877-a144-44ca-9911-360b44ea2aad tempest-VolumesActionsTest-896200989 None] Lock "cinder-69c2b3db-608b-4817-9709-d69b4e4bcb0e" acquired by "attach_volume" :: waited 0.039s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:47 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-15024877-a144-44ca-9911-360b44ea2aad tempest-VolumesActionsTest-896200989 None] Attaching volume 69c2b3db-608b-4817-9709-d69b4e4bcb0e to instance 79008fd4-02cc-4178-ad68-996d663db5f6 at mountpoint /dev/vdb on host None. Sep 10 19:56:47 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-15024877-a144-44ca-9911-360b44ea2aad tempest-VolumesActionsTest-896200989 None] Attach volume completed successfully. Sep 10 19:56:47 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-15024877-a144-44ca-9911-360b44ea2aad tempest-VolumesActionsTest-896200989 None] Lock "cinder-69c2b3db-608b-4817-9709-d69b4e4bcb0e" released by "attach_volume" :: held 0.133s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:48 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046 2147483648" returned: 0 in 0.732s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:48 devstack sudo[102536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046 Sep 10 19:56:48 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:48 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-e9dce4cb-e948-4d55-ba79-e16a58870ea8 tempest-VolumesActionsTest-177987727 None] Terminate volume connection completed successfully. Sep 10 19:56:48 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:48 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e9dce4cb-e948-4d55-ba79-e16a58870ea8 tempest-VolumesActionsTest-177987727 None] Acquiring lock "cinder-69c2b3db-608b-4817-9709-d69b4e4bcb0e-detach_volume" by "detach_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046" returned: 0 in 0.295s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:48 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:56:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:56:48 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e9dce4cb-e948-4d55-ba79-e16a58870ea8 tempest-VolumesActionsTest-177987727 None] Lock "cinder-69c2b3db-608b-4817-9709-d69b4e4bcb0e-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d25f9d4-cf71-4908-bce5-b9b23461b34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046', 'volume_size': 2}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d9964cd-a310-4346-b8bb-f8fce5283da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:48 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-e9dce4cb-e948-4d55-ba79-e16a58870ea8 tempest-VolumesActionsTest-177987727 None] Detaching volume 69c2b3db-608b-4817-9709-d69b4e4bcb0e from instance 79008fd4-02cc-4178-ad68-996d663db5f6. Sep 10 19:56:48 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Volume volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046 (c7f7481d-3a4c-4c3e-a90e-96f3d9414046): created successfully Sep 10 19:56:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d9964cd-a310-4346-b8bb-f8fce5283da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Flow 'volume_create_manager' (8e776ef4-2979-4059-823c-17b252ce318a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:56:48 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-d48ffa24-a97b-40e3-ad41-373d924a4f50 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Created volume successfully. Sep 10 19:56:48 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-e9dce4cb-e948-4d55-ba79-e16a58870ea8 tempest-VolumesActionsTest-177987727 None] Detach volume completed successfully. Sep 10 19:56:48 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e9dce4cb-e948-4d55-ba79-e16a58870ea8 tempest-VolumesActionsTest-177987727 None] Lock "cinder-69c2b3db-608b-4817-9709-d69b4e4bcb0e-detach_volume" released by "detach_volume" :: held 0.113s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:48 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-128358fa-39f7-48a1-86cf-6870a465ae08 tempest-VolumesActionsTest-896200989 None] Acquiring lock "cinder-69c2b3db-608b-4817-9709-d69b4e4bcb0e-detach_volume" by "detach_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:48 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-128358fa-39f7-48a1-86cf-6870a465ae08 tempest-VolumesActionsTest-896200989 None] Lock "cinder-69c2b3db-608b-4817-9709-d69b4e4bcb0e-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:48 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-128358fa-39f7-48a1-86cf-6870a465ae08 tempest-VolumesActionsTest-896200989 None] Volume detach called, but volume not attached. Sep 10 19:56:48 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-128358fa-39f7-48a1-86cf-6870a465ae08 tempest-VolumesActionsTest-896200989 None] Lock "cinder-69c2b3db-608b-4817-9709-d69b4e4bcb0e-detach_volume" released by "detach_volume" :: held 0.021s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-91868dc1-d15f-4b35-908a-cd4585f93f5f tempest-VolumesActionsTest-896200989 None] Acquiring lock "cinder-69c2b3db-608b-4817-9709-d69b4e4bcb0e-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-91868dc1-d15f-4b35-908a-cd4585f93f5f tempest-VolumesActionsTest-896200989 None] Lock "cinder-69c2b3db-608b-4817-9709-d69b4e4bcb0e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-91868dc1-d15f-4b35-908a-cd4585f93f5f tempest-VolumesActionsTest-896200989 None] Acquiring lock "cinder-quobyte-69c2b3db-608b-4817-9709-d69b4e4bcb0e" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-91868dc1-d15f-4b35-908a-cd4585f93f5f tempest-VolumesActionsTest-896200989 None] Lock "cinder-quobyte-69c2b3db-608b-4817-9709-d69b4e4bcb0e" acquired by "delete_volume" :: waited 0.035s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:49 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cb6106-1f93-4bb1-89db-8071b9ace541]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:56:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-91868dc1-d15f-4b35-908a-cd4585f93f5f tempest-VolumesActionsTest-896200989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-69c2b3db-608b-4817-9709-d69b4e4bcb0e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:49 devstack sudo[102539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-69c2b3db-608b-4817-9709-d69b4e4bcb0e Sep 10 19:56:49 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-354f6bf4-026a-4f41-845d-4b25d8b6509b tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:56:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-354f6bf4-026a-4f41-845d-4b25d8b6509b tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:56:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-354f6bf4-026a-4f41-845d-4b25d8b6509b tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Creating offline snapshot 68713793-c0fb-4341-b50c-7d612b1e6504 of volume c7f7481d-3a4c-4c3e-a90e-96f3d9414046 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 19:56:49 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f479c9e-bda6-4853-8b1a-53d738a34a9e]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:56:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-354f6bf4-026a-4f41-845d-4b25d8b6509b tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:49 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-91868dc1-d15f-4b35-908a-cd4585f93f5f tempest-VolumesActionsTest-896200989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-69c2b3db-608b-4817-9709-d69b4e4bcb0e" returned: 0 in 0.563s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-91868dc1-d15f-4b35-908a-cd4585f93f5f tempest-VolumesActionsTest-896200989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-69c2b3db-608b-4817-9709-d69b4e4bcb0e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:49 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-69c2b3db-608b-4817-9709-d69b4e4bcb0e Sep 10 19:56:49 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:49 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046 Sep 10 19:56:49 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:50 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-354f6bf4-026a-4f41-845d-4b25d8b6509b tempest-VolumesSnapshotNegativeTestJSON-566669574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046" returned: 0 in 0.463s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-354f6bf4-026a-4f41-845d-4b25d8b6509b tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046.68713793-c0fb-4341-b50c-7d612b1e6504 2G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:50 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-91868dc1-d15f-4b35-908a-cd4585f93f5f tempest-VolumesActionsTest-896200989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-69c2b3db-608b-4817-9709-d69b4e4bcb0e" returned: 0 in 0.396s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:50 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046.68713793-c0fb-4341-b50c-7d612b1e6504 2G Sep 10 19:56:50 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:50 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-91868dc1-d15f-4b35-908a-cd4585f93f5f tempest-VolumesActionsTest-896200989 None] Lock "cinder-quobyte-69c2b3db-608b-4817-9709-d69b4e4bcb0e" released by "delete_volume" :: held 1.019s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:50 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-91868dc1-d15f-4b35-908a-cd4585f93f5f tempest-VolumesActionsTest-896200989 None] Created reservations ['b736f53b-6344-40e5-ab28-e834dd7582e1', '96261085-b312-4ef2-8e34-f45a241676e5', '9df1a7ca-bfcf-4d00-9729-5e4a71a2a2c9', '73f02284-3c6c-4b2f-8dae-a3aa0bd79f85'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:56:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-91868dc1-d15f-4b35-908a-cd4585f93f5f tempest-VolumesActionsTest-896200989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:56:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-91868dc1-d15f-4b35-908a-cd4585f93f5f tempest-VolumesActionsTest-896200989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:56:50 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-91868dc1-d15f-4b35-908a-cd4585f93f5f tempest-VolumesActionsTest-896200989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:56:50 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-91868dc1-d15f-4b35-908a-cd4585f93f5f tempest-VolumesActionsTest-896200989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:56:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-91868dc1-d15f-4b35-908a-cd4585f93f5f tempest-VolumesActionsTest-896200989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:56:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-91868dc1-d15f-4b35-908a-cd4585f93f5f tempest-VolumesActionsTest-896200989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:50 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:56:50 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:50 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-91868dc1-d15f-4b35-908a-cd4585f93f5f tempest-VolumesActionsTest-896200989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.385s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:50 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-91868dc1-d15f-4b35-908a-cd4585f93f5f tempest-VolumesActionsTest-896200989 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:56:50 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-91868dc1-d15f-4b35-908a-cd4585f93f5f tempest-VolumesActionsTest-896200989 None] Deleted volume successfully. Sep 10 19:56:50 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-354f6bf4-026a-4f41-845d-4b25d8b6509b tempest-VolumesSnapshotNegativeTestJSON-566669574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046.68713793-c0fb-4341-b50c-7d612b1e6504 2G" returned: 0 in 0.667s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-354f6bf4-026a-4f41-845d-4b25d8b6509b tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046.68713793-c0fb-4341-b50c-7d612b1e6504 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:51 devstack sudo[102563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046.68713793-c0fb-4341-b50c-7d612b1e6504 Sep 10 19:56:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-91868dc1-d15f-4b35-908a-cd4585f93f5f tempest-VolumesActionsTest-896200989 None] Lock "cinder-69c2b3db-608b-4817-9709-d69b4e4bcb0e-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:51 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:51 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-354f6bf4-026a-4f41-845d-4b25d8b6509b tempest-VolumesSnapshotNegativeTestJSON-566669574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046.68713793-c0fb-4341-b50c-7d612b1e6504" returned: 0 in 0.376s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:51 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-354f6bf4-026a-4f41-845d-4b25d8b6509b tempest-VolumesSnapshotNegativeTestJSON-566669574 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046.68713793-c0fb-4341-b50c-7d612b1e6504 is being set with open permissions: ugo+rw Sep 10 19:56:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-354f6bf4-026a-4f41-845d-4b25d8b6509b tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046.68713793-c0fb-4341-b50c-7d612b1e6504 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:51 devstack sudo[102568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046.68713793-c0fb-4341-b50c-7d612b1e6504 Sep 10 19:56:51 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:51 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-354f6bf4-026a-4f41-845d-4b25d8b6509b tempest-VolumesSnapshotNegativeTestJSON-566669574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046.68713793-c0fb-4341-b50c-7d612b1e6504" returned: 0 in 0.289s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-354f6bf4-026a-4f41-845d-4b25d8b6509b tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:51 devstack sudo[102571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046.info Sep 10 19:56:51 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:52 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-354f6bf4-026a-4f41-845d-4b25d8b6509b tempest-VolumesSnapshotNegativeTestJSON-566669574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046.info" returned: 0 in 0.540s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:52 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-354f6bf4-026a-4f41-845d-4b25d8b6509b tempest-VolumesSnapshotNegativeTestJSON-566669574 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046.info is being set with open permissions: ugo+rw Sep 10 19:56:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-354f6bf4-026a-4f41-845d-4b25d8b6509b tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:52 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046.info Sep 10 19:56:52 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:52 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-354f6bf4-026a-4f41-845d-4b25d8b6509b tempest-VolumesSnapshotNegativeTestJSON-566669574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046.info" returned: 0 in 0.480s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-354f6bf4-026a-4f41-845d-4b25d8b6509b tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.960s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:56:52 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-354f6bf4-026a-4f41-845d-4b25d8b6509b tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Create snapshot completed successfully Sep 10 19:56:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-fc25544c-c1f3-4828-9f7b-e7d3e7ed8e99 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Acquiring lock "cinder-68713793-c0fb-4341-b50c-7d612b1e6504-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-fc25544c-c1f3-4828-9f7b-e7d3e7ed8e99 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Lock "cinder-68713793-c0fb-4341-b50c-7d612b1e6504-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-fc25544c-c1f3-4828-9f7b-e7d3e7ed8e99 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Acquiring lock "cinder-quobyte-c7f7481d-3a4c-4c3e-a90e-96f3d9414046" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-fc25544c-c1f3-4828-9f7b-e7d3e7ed8e99 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Lock "cinder-quobyte-c7f7481d-3a4c-4c3e-a90e-96f3d9414046" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-fc25544c-c1f3-4828-9f7b-e7d3e7ed8e99 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Acquiring lock "cinder-quobyte-68713793-c0fb-4341-b50c-7d612b1e6504" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-fc25544c-c1f3-4828-9f7b-e7d3e7ed8e99 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Lock "cinder-quobyte-68713793-c0fb-4341-b50c-7d612b1e6504" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:53 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-fc25544c-c1f3-4828-9f7b-e7d3e7ed8e99 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Deleting offline snapshot 68713793-c0fb-4341-b50c-7d612b1e6504 of volume c7f7481d-3a4c-4c3e-a90e-96f3d9414046 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 19:56:53 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-fc25544c-c1f3-4828-9f7b-e7d3e7ed8e99 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] snapshot_file for this snap is: volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046.68713793-c0fb-4341-b50c-7d612b1e6504 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 19:56:53 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaca0435-0bbe-45cb-91ee-e4d5d19ea332]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:56:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fc25544c-c1f3-4828-9f7b-e7d3e7ed8e99 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046.68713793-c0fb-4341-b50c-7d612b1e6504 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:53 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046.68713793-c0fb-4341-b50c-7d612b1e6504 Sep 10 19:56:53 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:53 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fc25544c-c1f3-4828-9f7b-e7d3e7ed8e99 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046.68713793-c0fb-4341-b50c-7d612b1e6504" returned: 0 in 0.535s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:53 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-fc25544c-c1f3-4828-9f7b-e7d3e7ed8e99 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:56:53 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae990bef-4265-498e-955a-81815c574ed8]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:56:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fc25544c-c1f3-4828-9f7b-e7d3e7ed8e99 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:54 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046 Sep 10 19:56:54 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:54 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fc25544c-c1f3-4828-9f7b-e7d3e7ed8e99 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046" returned: 0 in 0.436s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fc25544c-c1f3-4828-9f7b-e7d3e7ed8e99 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046.68713793-c0fb-4341-b50c-7d612b1e6504 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:54 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046.68713793-c0fb-4341-b50c-7d612b1e6504 Sep 10 19:56:54 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:54 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fc25544c-c1f3-4828-9f7b-e7d3e7ed8e99 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046.68713793-c0fb-4341-b50c-7d612b1e6504" returned: 0 in 0.425s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fc25544c-c1f3-4828-9f7b-e7d3e7ed8e99 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046.68713793-c0fb-4341-b50c-7d612b1e6504 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:54 devstack sudo[102621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046.68713793-c0fb-4341-b50c-7d612b1e6504 Sep 10 19:56:54 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:55 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fc25544c-c1f3-4828-9f7b-e7d3e7ed8e99 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046.68713793-c0fb-4341-b50c-7d612b1e6504" returned: 0 in 0.339s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-fc25544c-c1f3-4828-9f7b-e7d3e7ed8e99 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Lock "cinder-quobyte-68713793-c0fb-4341-b50c-7d612b1e6504" released by "_delete_snapshot" :: held 1.911s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-fc25544c-c1f3-4828-9f7b-e7d3e7ed8e99 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Lock "cinder-quobyte-c7f7481d-3a4c-4c3e-a90e-96f3d9414046" released by "delete_snapshot" :: held 1.936s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-fc25544c-c1f3-4828-9f7b-e7d3e7ed8e99 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Created reservations ['2686772a-33de-437c-a669-62847b38596f', '960b108e-a88d-4b46-b88b-89fe574fa781', '74a950c5-5046-45cb-9d84-0d9031ebba86', '4647bc11-8dca-4d17-9a94-272b0eaec4e4'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:56:55 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-fc25544c-c1f3-4828-9f7b-e7d3e7ed8e99 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Delete snapshot completed successfully. Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-fc25544c-c1f3-4828-9f7b-e7d3e7ed8e99 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Lock "cinder-68713793-c0fb-4341-b50c-7d612b1e6504-delete_snapshot" released by "delete_snapshot" :: held 2.157s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] Flow 'volume_create_manager' (83deb8f5-c328-49b7-92de-eca0e74ebf75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd1bebe8-38de-42c2-a78d-50ab04ed3265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd1bebe8-38de-42c2-a78d-50ab04ed3265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-274329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32314db6-e409-4856-ab03-a35ea34a3a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9728737eca423ba60791a04cbe1922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:56:55Z,use_quota=True,user_id='2a92e5c09b99490e8657883518873177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a2ae71-3cec-41ba-a6b0-07cd9df8ecaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a2ae71-3cec-41ba-a6b0-07cd9df8ecaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ffebc5-e6f9-41d9-bbda-8a47c1f5df9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ffebc5-e6f9-41d9-bbda-8a47c1f5df9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32314db6-e409-4856-ab03-a35ea34a3a4d', 'volume_name': 'volume-32314db6-e409-4856-ab03-a35ea34a3a4d', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3d5ff91-0119-45f9-a23e-c7683b8ce6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3d5ff91-0119-45f9-a23e-c7683b8ce6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36bee9cc-5933-4590-9ce5-a2d22c0b1faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:55 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] Volume 32314db6-e409-4856-ab03-a35ea34a3a4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32314db6-e409-4856-ab03-a35ea34a3a4d', 'volume_size': 1} Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-274329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32314db6-e409-4856-ab03-a35ea34a3a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9728737eca423ba60791a04cbe1922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:56:55Z,use_quota=True,user_id='2a92e5c09b99490e8657883518873177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] Creating volume 32314db6-e409-4856-ab03-a35ea34a3a4d {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:56:55 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-32314db6-e409-4856-ab03-a35ea34a3a4d 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cd4485af-1b5c-4ce0-bf20-a61b83be5072 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Acquiring lock "cinder-c7f7481d-3a4c-4c3e-a90e-96f3d9414046-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:55 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-32314db6-e409-4856-ab03-a35ea34a3a4d 1073741824 Sep 10 19:56:55 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cd4485af-1b5c-4ce0-bf20-a61b83be5072 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Lock "cinder-c7f7481d-3a4c-4c3e-a90e-96f3d9414046-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cd4485af-1b5c-4ce0-bf20-a61b83be5072 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Acquiring lock "cinder-quobyte-c7f7481d-3a4c-4c3e-a90e-96f3d9414046" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cd4485af-1b5c-4ce0-bf20-a61b83be5072 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Lock "cinder-quobyte-c7f7481d-3a4c-4c3e-a90e-96f3d9414046" acquired by "delete_volume" :: waited 0.015s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[2931c1b0-21c2-4fb7-b678-102767e381c8]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:56:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cd4485af-1b5c-4ce0-bf20-a61b83be5072 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:55 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046 Sep 10 19:56:55 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:56 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-32314db6-e409-4856-ab03-a35ea34a3a4d 1073741824" returned: 0 in 0.720s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:56 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cd4485af-1b5c-4ce0-bf20-a61b83be5072 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046" returned: 0 in 0.626s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cd4485af-1b5c-4ce0-bf20-a61b83be5072 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-32314db6-e409-4856-ab03-a35ea34a3a4d {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:56 devstack sudo[102635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046 Sep 10 19:56:56 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:56 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-32314db6-e409-4856-ab03-a35ea34a3a4d Sep 10 19:56:56 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:56 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-32314db6-e409-4856-ab03-a35ea34a3a4d" returned: 0 in 0.304s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:56:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:56:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36bee9cc-5933-4590-9ce5-a2d22c0b1faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32314db6-e409-4856-ab03-a35ea34a3a4d', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff20b7a5-c841-40c0-84e4-6f3e8e9e2e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:56 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cd4485af-1b5c-4ce0-bf20-a61b83be5072 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7f7481d-3a4c-4c3e-a90e-96f3d9414046" returned: 0 in 0.372s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:56 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] Volume volume-32314db6-e409-4856-ab03-a35ea34a3a4d (32314db6-e409-4856-ab03-a35ea34a3a4d): created successfully Sep 10 19:56:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff20b7a5-c841-40c0-84e4-6f3e8e9e2e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] Flow 'volume_create_manager' (83deb8f5-c328-49b7-92de-eca0e74ebf75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:56:56 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cd4485af-1b5c-4ce0-bf20-a61b83be5072 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Lock "cinder-quobyte-c7f7481d-3a4c-4c3e-a90e-96f3d9414046" released by "delete_volume" :: held 1.089s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:56 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-2a703646-1809-403f-987b-7b62dfdec5f6 tempest-VolumesActionsTest-896200989 None] Created volume successfully. Sep 10 19:56:56 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-cd4485af-1b5c-4ce0-bf20-a61b83be5072 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Created reservations ['480dc136-b930-48a1-a025-2ae2eaa8fa0a', '78665c77-5035-4f43-a9ea-05e3cb08255b', 'c6804873-ae5b-4e5e-9434-73d5ea4d5f24', 'a361e6c9-c78d-4685-8e31-a06226ff5327'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:56:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cd4485af-1b5c-4ce0-bf20-a61b83be5072 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:56:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cd4485af-1b5c-4ce0-bf20-a61b83be5072 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:56:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-cd4485af-1b5c-4ce0-bf20-a61b83be5072 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:56:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-cd4485af-1b5c-4ce0-bf20-a61b83be5072 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:56:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cd4485af-1b5c-4ce0-bf20-a61b83be5072 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:56:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cd4485af-1b5c-4ce0-bf20-a61b83be5072 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:56 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:56:56 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:57 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cd4485af-1b5c-4ce0-bf20-a61b83be5072 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.257s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:57 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-cd4485af-1b5c-4ce0-bf20-a61b83be5072 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:56:57 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-cd4485af-1b5c-4ce0-bf20-a61b83be5072 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Deleted volume successfully. Sep 10 19:56:57 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cd4485af-1b5c-4ce0-bf20-a61b83be5072 tempest-VolumesSnapshotNegativeTestJSON-566669574 None] Lock "cinder-c7f7481d-3a4c-4c3e-a90e-96f3d9414046-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:57 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-20c5588c-b51a-4db4-802d-72d0ad350c84 tempest-VolumesActionsTest-177987727 None] Acquiring lock "cinder-32314db6-e409-4856-ab03-a35ea34a3a4d-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:57 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-20c5588c-b51a-4db4-802d-72d0ad350c84 tempest-VolumesActionsTest-177987727 None] Lock "cinder-32314db6-e409-4856-ab03-a35ea34a3a4d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:57 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-20c5588c-b51a-4db4-802d-72d0ad350c84 tempest-VolumesActionsTest-177987727 None] Acquiring lock "cinder-quobyte-32314db6-e409-4856-ab03-a35ea34a3a4d" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:56:57 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-20c5588c-b51a-4db4-802d-72d0ad350c84 tempest-VolumesActionsTest-177987727 None] Lock "cinder-quobyte-32314db6-e409-4856-ab03-a35ea34a3a4d" acquired by "delete_volume" :: waited 0.018s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:56:57 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[5674e0a9-e8ac-4f48-b4b5-c01f38f3cbaa]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:56:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-20c5588c-b51a-4db4-802d-72d0ad350c84 tempest-VolumesActionsTest-177987727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-32314db6-e409-4856-ab03-a35ea34a3a4d {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:57 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-32314db6-e409-4856-ab03-a35ea34a3a4d Sep 10 19:56:57 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:58 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-20c5588c-b51a-4db4-802d-72d0ad350c84 tempest-VolumesActionsTest-177987727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-32314db6-e409-4856-ab03-a35ea34a3a4d" returned: 0 in 0.501s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-20c5588c-b51a-4db4-802d-72d0ad350c84 tempest-VolumesActionsTest-177987727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-32314db6-e409-4856-ab03-a35ea34a3a4d {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:58 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-32314db6-e409-4856-ab03-a35ea34a3a4d Sep 10 19:56:58 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:58 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-20c5588c-b51a-4db4-802d-72d0ad350c84 tempest-VolumesActionsTest-177987727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-32314db6-e409-4856-ab03-a35ea34a3a4d" returned: 0 in 0.292s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:58 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-20c5588c-b51a-4db4-802d-72d0ad350c84 tempest-VolumesActionsTest-177987727 None] Lock "cinder-quobyte-32314db6-e409-4856-ab03-a35ea34a3a4d" released by "delete_volume" :: held 0.846s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:58 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-20c5588c-b51a-4db4-802d-72d0ad350c84 tempest-VolumesActionsTest-177987727 None] Created reservations ['eeb8011a-a038-40dc-8dc2-329bd3985b4f', '605954a9-d7ce-4e17-b0d9-0c1715adc109', '455385ff-75e4-47eb-bd7a-952437f69517', '56c51bd7-bdfb-45b7-9fbb-b11fe408568c'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:56:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-20c5588c-b51a-4db4-802d-72d0ad350c84 tempest-VolumesActionsTest-177987727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:56:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-20c5588c-b51a-4db4-802d-72d0ad350c84 tempest-VolumesActionsTest-177987727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:56:58 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-20c5588c-b51a-4db4-802d-72d0ad350c84 tempest-VolumesActionsTest-177987727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:56:58 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-20c5588c-b51a-4db4-802d-72d0ad350c84 tempest-VolumesActionsTest-177987727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:56:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-20c5588c-b51a-4db4-802d-72d0ad350c84 tempest-VolumesActionsTest-177987727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:56:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-20c5588c-b51a-4db4-802d-72d0ad350c84 tempest-VolumesActionsTest-177987727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:58 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:56:58 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:56:59 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Sep 10 19:56:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-20c5588c-b51a-4db4-802d-72d0ad350c84 tempest-VolumesActionsTest-177987727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.374s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:56:59 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-20c5588c-b51a-4db4-802d-72d0ad350c84 tempest-VolumesActionsTest-177987727 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:56:59 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-20c5588c-b51a-4db4-802d-72d0ad350c84 tempest-VolumesActionsTest-177987727 None] Deleted volume successfully. Sep 10 19:56:59 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-20c5588c-b51a-4db4-802d-72d0ad350c84 tempest-VolumesActionsTest-177987727 None] Lock "cinder-32314db6-e409-4856-ab03-a35ea34a3a4d-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:56:59 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:56:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] Flow 'volume_create_manager' (86377832-9644-478c-8ec9-d257549d5860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:56:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da479331-88a2-435e-92f7-3e13444f1f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da479331-88a2-435e-92f7-3e13444f1f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1590727887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d542269-56c2-49a4-acdb-ff4cea52c09f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9728737eca423ba60791a04cbe1922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:57:00Z,use_quota=True,user_id='2a92e5c09b99490e8657883518873177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc80569-2965-4d2c-b977-0599de3310b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc80569-2965-4d2c-b977-0599de3310b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f05a735-03d0-434c-9e0f-c6f6c60ccb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f05a735-03d0-434c-9e0f-c6f6c60ccb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d542269-56c2-49a4-acdb-ff4cea52c09f', 'volume_name': 'volume-1d542269-56c2-49a4-acdb-ff4cea52c09f', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36dc97ab-8bd4-413e-8a1b-a8e40255ed0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36dc97ab-8bd4-413e-8a1b-a8e40255ed0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:56:59 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d0d7c8-3a61-4a30-9449-c205b183e4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:56:59 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] Volume 1d542269-56c2-49a4-acdb-ff4cea52c09f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d542269-56c2-49a4-acdb-ff4cea52c09f', 'volume_size': 1} Sep 10 19:56:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:56:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:56:59 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1590727887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d542269-56c2-49a4-acdb-ff4cea52c09f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9728737eca423ba60791a04cbe1922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:57:00Z,use_quota=True,user_id='2a92e5c09b99490e8657883518873177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:56:59 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] Creating volume 1d542269-56c2-49a4-acdb-ff4cea52c09f {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:56:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:56:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:56:59 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:56:59 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:56:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:56:59 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:56:59 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:56:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1d542269-56c2-49a4-acdb-ff4cea52c09f 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:56:59 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1d542269-56c2-49a4-acdb-ff4cea52c09f 1073741824 Sep 10 19:56:59 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:00 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1d542269-56c2-49a4-acdb-ff4cea52c09f 1073741824" returned: 0 in 0.594s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1d542269-56c2-49a4-acdb-ff4cea52c09f {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:00 devstack sudo[102662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1d542269-56c2-49a4-acdb-ff4cea52c09f Sep 10 19:57:00 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:00 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1d542269-56c2-49a4-acdb-ff4cea52c09f" returned: 0 in 0.295s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:00 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:57:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d0d7c8-3a61-4a30-9449-c205b183e4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d542269-56c2-49a4-acdb-ff4cea52c09f', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a978ecf2-6f63-4c35-af56-1612376da0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:00 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] Volume volume-1d542269-56c2-49a4-acdb-ff4cea52c09f (1d542269-56c2-49a4-acdb-ff4cea52c09f): created successfully Sep 10 19:57:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a978ecf2-6f63-4c35-af56-1612376da0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] Flow 'volume_create_manager' (86377832-9644-478c-8ec9-d257549d5860) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:57:00 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-df26491a-b39e-423b-a527-afba67427859 tempest-VolumesActionsTest-896200989 None] Created volume successfully. Sep 10 19:57:01 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e4a6d43e-a77c-4342-a83e-8d0a126dae38 tempest-VolumesActionsTest-177987727 None] Acquiring lock "cinder-1d542269-56c2-49a4-acdb-ff4cea52c09f-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:57:01 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e4a6d43e-a77c-4342-a83e-8d0a126dae38 tempest-VolumesActionsTest-177987727 None] Lock "cinder-1d542269-56c2-49a4-acdb-ff4cea52c09f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:57:01 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e4a6d43e-a77c-4342-a83e-8d0a126dae38 tempest-VolumesActionsTest-177987727 None] Acquiring lock "cinder-quobyte-1d542269-56c2-49a4-acdb-ff4cea52c09f" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:57:01 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e4a6d43e-a77c-4342-a83e-8d0a126dae38 tempest-VolumesActionsTest-177987727 None] Lock "cinder-quobyte-1d542269-56c2-49a4-acdb-ff4cea52c09f" acquired by "delete_volume" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:57:01 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c381bb8-9a01-411c-a9de-188cd1a2aed9]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:57:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e4a6d43e-a77c-4342-a83e-8d0a126dae38 tempest-VolumesActionsTest-177987727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1d542269-56c2-49a4-acdb-ff4cea52c09f {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:02 devstack sudo[102665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1d542269-56c2-49a4-acdb-ff4cea52c09f Sep 10 19:57:02 devstack sudo[102665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:02 devstack sudo[102665]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e4a6d43e-a77c-4342-a83e-8d0a126dae38 tempest-VolumesActionsTest-177987727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1d542269-56c2-49a4-acdb-ff4cea52c09f" returned: 0 in 0.467s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e4a6d43e-a77c-4342-a83e-8d0a126dae38 tempest-VolumesActionsTest-177987727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1d542269-56c2-49a4-acdb-ff4cea52c09f {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:02 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1d542269-56c2-49a4-acdb-ff4cea52c09f Sep 10 19:57:02 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:02 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e4a6d43e-a77c-4342-a83e-8d0a126dae38 tempest-VolumesActionsTest-177987727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1d542269-56c2-49a4-acdb-ff4cea52c09f" returned: 0 in 0.312s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:02 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e4a6d43e-a77c-4342-a83e-8d0a126dae38 tempest-VolumesActionsTest-177987727 None] Lock "cinder-quobyte-1d542269-56c2-49a4-acdb-ff4cea52c09f" released by "delete_volume" :: held 0.837s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:57:02 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-e4a6d43e-a77c-4342-a83e-8d0a126dae38 tempest-VolumesActionsTest-177987727 None] Created reservations ['aa7a058c-515b-47af-8064-c11d3b16b25d', 'ee998b76-f701-4545-aa24-6518411dcf35', 'bc832ebc-250d-4a20-9643-832bf321dceb', '2b8bd8df-5993-46d9-a3dc-27c5cc8c908e'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:57:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e4a6d43e-a77c-4342-a83e-8d0a126dae38 tempest-VolumesActionsTest-177987727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e4a6d43e-a77c-4342-a83e-8d0a126dae38 tempest-VolumesActionsTest-177987727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:02 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e4a6d43e-a77c-4342-a83e-8d0a126dae38 tempest-VolumesActionsTest-177987727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:57:02 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e4a6d43e-a77c-4342-a83e-8d0a126dae38 tempest-VolumesActionsTest-177987727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:57:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e4a6d43e-a77c-4342-a83e-8d0a126dae38 tempest-VolumesActionsTest-177987727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e4a6d43e-a77c-4342-a83e-8d0a126dae38 tempest-VolumesActionsTest-177987727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:02 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:57:02 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:03 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e4a6d43e-a77c-4342-a83e-8d0a126dae38 tempest-VolumesActionsTest-177987727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.370s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-e4a6d43e-a77c-4342-a83e-8d0a126dae38 tempest-VolumesActionsTest-177987727 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:57:03 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-e4a6d43e-a77c-4342-a83e-8d0a126dae38 tempest-VolumesActionsTest-177987727 None] Deleted volume successfully. Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e4a6d43e-a77c-4342-a83e-8d0a126dae38 tempest-VolumesActionsTest-177987727 None] Lock "cinder-1d542269-56c2-49a4-acdb-ff4cea52c09f-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] Flow 'volume_create_manager' (6618f39c-fa99-4cb3-a29a-0dd7ba9e033b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1459cea1-e0dd-4a4d-ad1c-2367f330f6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1459cea1-e0dd-4a4d-ad1c-2367f330f6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-851038591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865f7753-4d42-47db-a0a3-2fd806d29386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9728737eca423ba60791a04cbe1922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:57:04Z,use_quota=True,user_id='2a92e5c09b99490e8657883518873177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e81b707d-8940-47ae-9c74-0d74681d2a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e81b707d-8940-47ae-9c74-0d74681d2a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3af7fcd-38f3-4601-8b98-e4201dbaed69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3af7fcd-38f3-4601-8b98-e4201dbaed69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '865f7753-4d42-47db-a0a3-2fd806d29386', 'volume_name': 'volume-865f7753-4d42-47db-a0a3-2fd806d29386', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (731c303f-3f21-43de-9529-6ef29219e7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (731c303f-3f21-43de-9529-6ef29219e7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15025fb2-9780-435c-a7c5-44cd78d546e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:03 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] Volume 865f7753-4d42-47db-a0a3-2fd806d29386: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-865f7753-4d42-47db-a0a3-2fd806d29386', 'volume_size': 1} Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-851038591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865f7753-4d42-47db-a0a3-2fd806d29386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9728737eca423ba60791a04cbe1922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:57:04Z,use_quota=True,user_id='2a92e5c09b99490e8657883518873177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] Creating volume 865f7753-4d42-47db-a0a3-2fd806d29386 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:57:03 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-865f7753-4d42-47db-a0a3-2fd806d29386 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:03 devstack sudo[102676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-865f7753-4d42-47db-a0a3-2fd806d29386 1073741824 Sep 10 19:57:03 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:04 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:57:04 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:04 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.416s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:04 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:57:04 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager._thread_info {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:57:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread count: 28 {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 19:57:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread info: [<_MainThread(MainThread, started 138417491665024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 19:57:04 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-865f7753-4d42-47db-a0a3-2fd806d29386 1073741824" returned: 0 in 0.694s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-865f7753-4d42-47db-a0a3-2fd806d29386 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:04 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-865f7753-4d42-47db-a0a3-2fd806d29386 Sep 10 19:57:04 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:05 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-865f7753-4d42-47db-a0a3-2fd806d29386" returned: 0 in 0.306s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:57:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15025fb2-9780-435c-a7c5-44cd78d546e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-865f7753-4d42-47db-a0a3-2fd806d29386', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf040794-27e3-4a86-84f3-374b95452cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:05 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] Volume volume-865f7753-4d42-47db-a0a3-2fd806d29386 (865f7753-4d42-47db-a0a3-2fd806d29386): created successfully Sep 10 19:57:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf040794-27e3-4a86-84f3-374b95452cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] Flow 'volume_create_manager' (6618f39c-fa99-4cb3-a29a-0dd7ba9e033b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:57:05 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-52679215-e919-43dd-9311-4679babe6ef4 tempest-VolumesActionsTest-896200989 None] Created volume successfully. Sep 10 19:57:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2d44bfd7-f5e8-4479-a6c5-38e3ceab6ddd tempest-VolumesActionsTest-177987727 None] Acquiring lock "cinder-865f7753-4d42-47db-a0a3-2fd806d29386-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:57:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2d44bfd7-f5e8-4479-a6c5-38e3ceab6ddd tempest-VolumesActionsTest-177987727 None] Lock "cinder-865f7753-4d42-47db-a0a3-2fd806d29386-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:57:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2d44bfd7-f5e8-4479-a6c5-38e3ceab6ddd tempest-VolumesActionsTest-177987727 None] Acquiring lock "cinder-quobyte-865f7753-4d42-47db-a0a3-2fd806d29386" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:57:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2d44bfd7-f5e8-4479-a6c5-38e3ceab6ddd tempest-VolumesActionsTest-177987727 None] Lock "cinder-quobyte-865f7753-4d42-47db-a0a3-2fd806d29386" acquired by "delete_volume" :: waited 0.020s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:57:06 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[879e5214-973e-4660-9798-c7b5c45552f9]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:57:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2d44bfd7-f5e8-4479-a6c5-38e3ceab6ddd tempest-VolumesActionsTest-177987727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-865f7753-4d42-47db-a0a3-2fd806d29386 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:06 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-865f7753-4d42-47db-a0a3-2fd806d29386 Sep 10 19:57:06 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:06 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2d44bfd7-f5e8-4479-a6c5-38e3ceab6ddd tempest-VolumesActionsTest-177987727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-865f7753-4d42-47db-a0a3-2fd806d29386" returned: 0 in 0.423s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2d44bfd7-f5e8-4479-a6c5-38e3ceab6ddd tempest-VolumesActionsTest-177987727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-865f7753-4d42-47db-a0a3-2fd806d29386 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:06 devstack sudo[102694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-865f7753-4d42-47db-a0a3-2fd806d29386 Sep 10 19:57:06 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:06 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2d44bfd7-f5e8-4479-a6c5-38e3ceab6ddd tempest-VolumesActionsTest-177987727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-865f7753-4d42-47db-a0a3-2fd806d29386" returned: 0 in 0.279s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2d44bfd7-f5e8-4479-a6c5-38e3ceab6ddd tempest-VolumesActionsTest-177987727 None] Lock "cinder-quobyte-865f7753-4d42-47db-a0a3-2fd806d29386" released by "delete_volume" :: held 0.764s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:57:07 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-2d44bfd7-f5e8-4479-a6c5-38e3ceab6ddd tempest-VolumesActionsTest-177987727 None] Created reservations ['14dd9d7e-e87b-46eb-9fc5-59c7073ae646', '2e72a12e-556f-436b-98f1-f06078663cf8', '4bf22716-ffc9-4991-93b4-31e22c5949b1', '9c63663e-fbaa-42b4-abf0-ed07b7276c89'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:57:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2d44bfd7-f5e8-4479-a6c5-38e3ceab6ddd tempest-VolumesActionsTest-177987727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2d44bfd7-f5e8-4479-a6c5-38e3ceab6ddd tempest-VolumesActionsTest-177987727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2d44bfd7-f5e8-4479-a6c5-38e3ceab6ddd tempest-VolumesActionsTest-177987727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:57:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2d44bfd7-f5e8-4479-a6c5-38e3ceab6ddd tempest-VolumesActionsTest-177987727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:57:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2d44bfd7-f5e8-4479-a6c5-38e3ceab6ddd tempest-VolumesActionsTest-177987727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2d44bfd7-f5e8-4479-a6c5-38e3ceab6ddd tempest-VolumesActionsTest-177987727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:07 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:57:07 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:07 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2d44bfd7-f5e8-4479-a6c5-38e3ceab6ddd tempest-VolumesActionsTest-177987727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.362s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:07 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-2d44bfd7-f5e8-4479-a6c5-38e3ceab6ddd tempest-VolumesActionsTest-177987727 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:57:07 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-2d44bfd7-f5e8-4479-a6c5-38e3ceab6ddd tempest-VolumesActionsTest-177987727 None] Deleted volume successfully. Sep 10 19:57:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2d44bfd7-f5e8-4479-a6c5-38e3ceab6ddd tempest-VolumesActionsTest-177987727 None] Lock "cinder-865f7753-4d42-47db-a0a3-2fd806d29386-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:57:08 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:57:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] Flow 'volume_create_manager' (fb4292cc-768e-4a38-80af-07b7089dac21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:57:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5ca1e18-c9b6-401b-ad69-29806db245c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5ca1e18-c9b6-401b-ad69-29806db245c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1822325665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ad35102-f693-40b5-9ae2-c99a03c07596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9728737eca423ba60791a04cbe1922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:57:08Z,use_quota=True,user_id='2a92e5c09b99490e8657883518873177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc04226-3d10-4dd6-88e7-7e888264a3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc04226-3d10-4dd6-88e7-7e888264a3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b287d1e-3468-47ef-a913-008a8a882302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b287d1e-3468-47ef-a913-008a8a882302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ad35102-f693-40b5-9ae2-c99a03c07596', 'volume_name': 'volume-2ad35102-f693-40b5-9ae2-c99a03c07596', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8921dc8d-b700-4ad4-bd6c-157ddb9e3982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8921dc8d-b700-4ad4-bd6c-157ddb9e3982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6aac520-478f-47a7-a385-a5517ebb2df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:08 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] Volume 2ad35102-f693-40b5-9ae2-c99a03c07596: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ad35102-f693-40b5-9ae2-c99a03c07596', 'volume_size': 1} Sep 10 19:57:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1822325665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ad35102-f693-40b5-9ae2-c99a03c07596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9728737eca423ba60791a04cbe1922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:57:08Z,use_quota=True,user_id='2a92e5c09b99490e8657883518873177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:57:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] Creating volume 2ad35102-f693-40b5-9ae2-c99a03c07596 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:57:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:57:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:57:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:57:08 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:57:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2ad35102-f693-40b5-9ae2-c99a03c07596 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:08 devstack sudo[102700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2ad35102-f693-40b5-9ae2-c99a03c07596 1073741824 Sep 10 19:57:08 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:08 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2ad35102-f693-40b5-9ae2-c99a03c07596 1073741824" returned: 0 in 0.526s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2ad35102-f693-40b5-9ae2-c99a03c07596 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:08 devstack sudo[102706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2ad35102-f693-40b5-9ae2-c99a03c07596 Sep 10 19:57:08 devstack sudo[102706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:09 devstack sudo[102706]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2ad35102-f693-40b5-9ae2-c99a03c07596" returned: 0 in 0.302s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:09 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:57:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:09 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6aac520-478f-47a7-a385-a5517ebb2df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ad35102-f693-40b5-9ae2-c99a03c07596', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:09 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c2014a1-7298-404e-9013-f792138c37f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:09 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] Volume volume-2ad35102-f693-40b5-9ae2-c99a03c07596 (2ad35102-f693-40b5-9ae2-c99a03c07596): created successfully Sep 10 19:57:09 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c2014a1-7298-404e-9013-f792138c37f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:09 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] Flow 'volume_create_manager' (fb4292cc-768e-4a38-80af-07b7089dac21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:57:09 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-b8f3b921-77e0-4c8b-9877-b3e31910dc51 tempest-VolumesActionsTest-896200989 None] Created volume successfully. Sep 10 19:57:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-69df8cd9-4c47-4c01-9aad-0e5d8b98b82f tempest-VolumesActionsTest-177987727 None] Acquiring lock "cinder-2ad35102-f693-40b5-9ae2-c99a03c07596-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:57:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-69df8cd9-4c47-4c01-9aad-0e5d8b98b82f tempest-VolumesActionsTest-177987727 None] Lock "cinder-2ad35102-f693-40b5-9ae2-c99a03c07596-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:57:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-69df8cd9-4c47-4c01-9aad-0e5d8b98b82f tempest-VolumesActionsTest-177987727 None] Acquiring lock "cinder-quobyte-2ad35102-f693-40b5-9ae2-c99a03c07596" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:57:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-69df8cd9-4c47-4c01-9aad-0e5d8b98b82f tempest-VolumesActionsTest-177987727 None] Lock "cinder-quobyte-2ad35102-f693-40b5-9ae2-c99a03c07596" acquired by "delete_volume" :: waited 0.021s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:57:10 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bad0410-a808-4134-b772-b6a7c583e0d6]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:57:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-69df8cd9-4c47-4c01-9aad-0e5d8b98b82f tempest-VolumesActionsTest-177987727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2ad35102-f693-40b5-9ae2-c99a03c07596 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:10 devstack sudo[102710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2ad35102-f693-40b5-9ae2-c99a03c07596 Sep 10 19:57:10 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:10 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-69df8cd9-4c47-4c01-9aad-0e5d8b98b82f tempest-VolumesActionsTest-177987727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2ad35102-f693-40b5-9ae2-c99a03c07596" returned: 0 in 0.457s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-69df8cd9-4c47-4c01-9aad-0e5d8b98b82f tempest-VolumesActionsTest-177987727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2ad35102-f693-40b5-9ae2-c99a03c07596 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:11 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2ad35102-f693-40b5-9ae2-c99a03c07596 Sep 10 19:57:11 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:11 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-69df8cd9-4c47-4c01-9aad-0e5d8b98b82f tempest-VolumesActionsTest-177987727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2ad35102-f693-40b5-9ae2-c99a03c07596" returned: 0 in 0.350s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:11 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-69df8cd9-4c47-4c01-9aad-0e5d8b98b82f tempest-VolumesActionsTest-177987727 None] Lock "cinder-quobyte-2ad35102-f693-40b5-9ae2-c99a03c07596" released by "delete_volume" :: held 0.853s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:57:11 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-69df8cd9-4c47-4c01-9aad-0e5d8b98b82f tempest-VolumesActionsTest-177987727 None] Created reservations ['3a542541-1f1f-4473-bb0a-33962fdc8e74', 'e8e932c5-2a8d-4b0e-bc98-9e799c82c661', '28be91ea-54bc-4e02-b125-5c4cce2f8f8e', '31acda41-38fb-486a-af99-51894aefd488'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:57:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-69df8cd9-4c47-4c01-9aad-0e5d8b98b82f tempest-VolumesActionsTest-177987727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-69df8cd9-4c47-4c01-9aad-0e5d8b98b82f tempest-VolumesActionsTest-177987727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-69df8cd9-4c47-4c01-9aad-0e5d8b98b82f tempest-VolumesActionsTest-177987727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:57:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-69df8cd9-4c47-4c01-9aad-0e5d8b98b82f tempest-VolumesActionsTest-177987727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:57:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-69df8cd9-4c47-4c01-9aad-0e5d8b98b82f tempest-VolumesActionsTest-177987727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-69df8cd9-4c47-4c01-9aad-0e5d8b98b82f tempest-VolumesActionsTest-177987727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:11 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:57:11 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:11 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-69df8cd9-4c47-4c01-9aad-0e5d8b98b82f tempest-VolumesActionsTest-177987727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.338s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:11 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-69df8cd9-4c47-4c01-9aad-0e5d8b98b82f tempest-VolumesActionsTest-177987727 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:57:11 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-69df8cd9-4c47-4c01-9aad-0e5d8b98b82f tempest-VolumesActionsTest-177987727 None] Deleted volume successfully. Sep 10 19:57:11 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-69df8cd9-4c47-4c01-9aad-0e5d8b98b82f tempest-VolumesActionsTest-177987727 None] Lock "cinder-2ad35102-f693-40b5-9ae2-c99a03c07596-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:57:12 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:57:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] Flow 'volume_create_manager' (f8e86a04-6083-4638-a334-8fd4ebbab08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:57:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32660aac-2aab-47b7-8fd6-51e6d3de9c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32660aac-2aab-47b7-8fd6-51e6d3de9c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1679266702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2a4db58-2223-4450-a1e0-8340c7a88e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9728737eca423ba60791a04cbe1922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:57:12Z,use_quota=True,user_id='2a92e5c09b99490e8657883518873177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca026a74-d48e-4fe4-9f86-15d3ba69b9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca026a74-d48e-4fe4-9f86-15d3ba69b9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d81495-a0de-42ab-96ef-169e0dc6b65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d81495-a0de-42ab-96ef-169e0dc6b65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2a4db58-2223-4450-a1e0-8340c7a88e51', 'volume_name': 'volume-c2a4db58-2223-4450-a1e0-8340c7a88e51', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a598e91-3016-4f53-8a9f-69327240cef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a598e91-3016-4f53-8a9f-69327240cef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2896d974-7cc6-4200-91d5-723d613d713d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:12 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] Volume c2a4db58-2223-4450-a1e0-8340c7a88e51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2a4db58-2223-4450-a1e0-8340c7a88e51', 'volume_size': 1} Sep 10 19:57:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:12 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1679266702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2a4db58-2223-4450-a1e0-8340c7a88e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9728737eca423ba60791a04cbe1922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:57:12Z,use_quota=True,user_id='2a92e5c09b99490e8657883518873177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:57:12 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] Creating volume c2a4db58-2223-4450-a1e0-8340c7a88e51 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:57:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:12 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:57:12 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:57:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:12 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:57:12 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:57:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c2a4db58-2223-4450-a1e0-8340c7a88e51 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:12 devstack sudo[102722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c2a4db58-2223-4450-a1e0-8340c7a88e51 1073741824 Sep 10 19:57:12 devstack sudo[102722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:13 devstack sudo[102722]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c2a4db58-2223-4450-a1e0-8340c7a88e51 1073741824" returned: 0 in 0.663s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c2a4db58-2223-4450-a1e0-8340c7a88e51 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:13 devstack sudo[102728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c2a4db58-2223-4450-a1e0-8340c7a88e51 Sep 10 19:57:13 devstack sudo[102728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:13 devstack sudo[102728]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c2a4db58-2223-4450-a1e0-8340c7a88e51" returned: 0 in 0.368s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:13 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:57:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2896d974-7cc6-4200-91d5-723d613d713d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2a4db58-2223-4450-a1e0-8340c7a88e51', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8095231-b118-430b-9f01-7093a91f4640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:13 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] Volume volume-c2a4db58-2223-4450-a1e0-8340c7a88e51 (c2a4db58-2223-4450-a1e0-8340c7a88e51): created successfully Sep 10 19:57:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8095231-b118-430b-9f01-7093a91f4640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] Flow 'volume_create_manager' (f8e86a04-6083-4638-a334-8fd4ebbab08f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:57:13 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-ad0d1cbc-076f-40a1-8895-899f0d127d5c tempest-VolumesActionsTest-896200989 None] Created volume successfully. Sep 10 19:57:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-46843952-558c-49df-b5a3-b374a3ac07ad tempest-VolumesActionsTest-896200989 None] Acquiring lock "cinder-c2a4db58-2223-4450-a1e0-8340c7a88e51-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:57:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-46843952-558c-49df-b5a3-b374a3ac07ad tempest-VolumesActionsTest-896200989 None] Lock "cinder-c2a4db58-2223-4450-a1e0-8340c7a88e51-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:57:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-46843952-558c-49df-b5a3-b374a3ac07ad tempest-VolumesActionsTest-896200989 None] Acquiring lock "cinder-quobyte-c2a4db58-2223-4450-a1e0-8340c7a88e51" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:57:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-46843952-558c-49df-b5a3-b374a3ac07ad tempest-VolumesActionsTest-896200989 None] Lock "cinder-quobyte-c2a4db58-2223-4450-a1e0-8340c7a88e51" acquired by "delete_volume" :: waited 0.015s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:57:15 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b942161-e345-4352-b43c-80f30ba465c3]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:57:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-46843952-558c-49df-b5a3-b374a3ac07ad tempest-VolumesActionsTest-896200989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c2a4db58-2223-4450-a1e0-8340c7a88e51 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:15 devstack sudo[102731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c2a4db58-2223-4450-a1e0-8340c7a88e51 Sep 10 19:57:15 devstack sudo[102731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:16 devstack sudo[102731]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-46843952-558c-49df-b5a3-b374a3ac07ad tempest-VolumesActionsTest-896200989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c2a4db58-2223-4450-a1e0-8340c7a88e51" returned: 0 in 0.522s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-46843952-558c-49df-b5a3-b374a3ac07ad tempest-VolumesActionsTest-896200989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c2a4db58-2223-4450-a1e0-8340c7a88e51 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:16 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c2a4db58-2223-4450-a1e0-8340c7a88e51 Sep 10 19:57:16 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:16 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-46843952-558c-49df-b5a3-b374a3ac07ad tempest-VolumesActionsTest-896200989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c2a4db58-2223-4450-a1e0-8340c7a88e51" returned: 0 in 0.277s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-46843952-558c-49df-b5a3-b374a3ac07ad tempest-VolumesActionsTest-896200989 None] Lock "cinder-quobyte-c2a4db58-2223-4450-a1e0-8340c7a88e51" released by "delete_volume" :: held 0.886s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:57:16 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-46843952-558c-49df-b5a3-b374a3ac07ad tempest-VolumesActionsTest-896200989 None] Created reservations ['2ca1643a-b609-46c6-8b38-2689ac740477', '87c60ce3-ac3c-4d8e-9a2a-51664ac0a982', '7a8e81f5-a519-4926-af52-42d03c5db4a0', '7b236765-66a0-4f22-be82-7f0932c50033'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:57:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-46843952-558c-49df-b5a3-b374a3ac07ad tempest-VolumesActionsTest-896200989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-46843952-558c-49df-b5a3-b374a3ac07ad tempest-VolumesActionsTest-896200989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:16 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-46843952-558c-49df-b5a3-b374a3ac07ad tempest-VolumesActionsTest-896200989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:57:16 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-46843952-558c-49df-b5a3-b374a3ac07ad tempest-VolumesActionsTest-896200989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:57:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-46843952-558c-49df-b5a3-b374a3ac07ad tempest-VolumesActionsTest-896200989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-46843952-558c-49df-b5a3-b374a3ac07ad tempest-VolumesActionsTest-896200989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:16 devstack sudo[102740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:57:16 devstack sudo[102740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:16 devstack sudo[102740]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-46843952-558c-49df-b5a3-b374a3ac07ad tempest-VolumesActionsTest-896200989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.312s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:16 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-46843952-558c-49df-b5a3-b374a3ac07ad tempest-VolumesActionsTest-896200989 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:57:16 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-46843952-558c-49df-b5a3-b374a3ac07ad tempest-VolumesActionsTest-896200989 None] Deleted volume successfully. Sep 10 19:57:17 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-46843952-558c-49df-b5a3-b374a3ac07ad tempest-VolumesActionsTest-896200989 None] Lock "cinder-c2a4db58-2223-4450-a1e0-8340c7a88e51-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] Flow 'volume_create_manager' (67255bf7-afb2-40e2-90b6-8e5ec22c90f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9331ab8d-501d-4611-8479-8dda26e3b9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9331ab8d-501d-4611-8479-8dda26e3b9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1900725324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153c7dfc-f6ae-45e5-a128-52cf6f3e1742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54a2ca13c7c942e083eb57d8b2374200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:57:19Z,use_quota=True,user_id='5972b0b4770c4ca485526a283bbb661e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e66771-8888-4f0e-8a97-1f41f5c3276a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e66771-8888-4f0e-8a97-1f41f5c3276a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e740f129-5157-4883-9834-1642c4d05437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e740f129-5157-4883-9834-1642c4d05437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '153c7dfc-f6ae-45e5-a128-52cf6f3e1742', 'volume_name': 'volume-153c7dfc-f6ae-45e5-a128-52cf6f3e1742', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f9f999-70b4-4975-b707-4f786e61b3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f9f999-70b4-4975-b707-4f786e61b3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0048d44a-a782-4da0-8f4e-890644593c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:19 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] Volume 153c7dfc-f6ae-45e5-a128-52cf6f3e1742: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-153c7dfc-f6ae-45e5-a128-52cf6f3e1742', 'volume_size': 1} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1900725324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153c7dfc-f6ae-45e5-a128-52cf6f3e1742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54a2ca13c7c942e083eb57d8b2374200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:57:19Z,use_quota=True,user_id='5972b0b4770c4ca485526a283bbb661e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] Creating volume 153c7dfc-f6ae-45e5-a128-52cf6f3e1742 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:57:19 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-153c7dfc-f6ae-45e5-a128-52cf6f3e1742 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:19 devstack sudo[102744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-153c7dfc-f6ae-45e5-a128-52cf6f3e1742 1073741824 Sep 10 19:57:19 devstack sudo[102744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] Flow 'volume_create_manager' (d85e9669-afd1-424c-82ca-5a2a2ad476b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e3de78d-9310-4331-bf92-74cfb8516ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e3de78d-9310-4331-bf92-74cfb8516ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-876441751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43257de5-bd6a-4b4e-9fba-d79a5c8f790e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54a2ca13c7c942e083eb57d8b2374200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:57:20Z,use_quota=True,user_id='5972b0b4770c4ca485526a283bbb661e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc70c22-a2ec-48f5-bd65-7c8d4c791727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc70c22-a2ec-48f5-bd65-7c8d4c791727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e2581ce-1592-476d-bb95-9149010d7b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e2581ce-1592-476d-bb95-9149010d7b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43257de5-bd6a-4b4e-9fba-d79a5c8f790e', 'volume_name': 'volume-43257de5-bd6a-4b4e-9fba-d79a5c8f790e', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca1a4a53-6b91-435d-8934-2b27274e33ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca1a4a53-6b91-435d-8934-2b27274e33ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1789ead3-5a25-4cc2-83a4-0321c5246ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:19 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] Volume 43257de5-bd6a-4b4e-9fba-d79a5c8f790e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43257de5-bd6a-4b4e-9fba-d79a5c8f790e', 'volume_size': 1} Sep 10 19:57:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:20 devstack sudo[102744]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-153c7dfc-f6ae-45e5-a128-52cf6f3e1742 1073741824" returned: 0 in 0.659s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-153c7dfc-f6ae-45e5-a128-52cf6f3e1742 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:20 devstack sudo[102751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-153c7dfc-f6ae-45e5-a128-52cf6f3e1742 Sep 10 19:57:20 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:20 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-153c7dfc-f6ae-45e5-a128-52cf6f3e1742" returned: 0 in 0.288s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:20 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:57:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.532s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:20 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-876441751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43257de5-bd6a-4b4e-9fba-d79a5c8f790e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54a2ca13c7c942e083eb57d8b2374200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:57:20Z,use_quota=True,user_id='5972b0b4770c4ca485526a283bbb661e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:57:20 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] Creating volume 43257de5-bd6a-4b4e-9fba-d79a5c8f790e {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:57:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:20 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:57:20 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:57:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:20 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:57:20 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:57:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-43257de5-bd6a-4b4e-9fba-d79a5c8f790e 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:20 devstack sudo[102755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-43257de5-bd6a-4b4e-9fba-d79a5c8f790e 1073741824 Sep 10 19:57:20 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0048d44a-a782-4da0-8f4e-890644593c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-153c7dfc-f6ae-45e5-a128-52cf6f3e1742', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:20 devstack sudo[102755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:20 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8435143-016d-47fa-ad42-1cfa2e5a3b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:20 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] Volume volume-153c7dfc-f6ae-45e5-a128-52cf6f3e1742 (153c7dfc-f6ae-45e5-a128-52cf6f3e1742): created successfully Sep 10 19:57:20 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8435143-016d-47fa-ad42-1cfa2e5a3b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:20 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] Flow 'volume_create_manager' (67255bf7-afb2-40e2-90b6-8e5ec22c90f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:57:20 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-2ec891eb-c58c-457a-945e-7dfdd218718f tempest-TestServerVolumeAttachmentScenario-29456212 None] Created volume successfully. Sep 10 19:57:21 devstack sudo[102755]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-43257de5-bd6a-4b4e-9fba-d79a5c8f790e 1073741824" returned: 0 in 0.581s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-43257de5-bd6a-4b4e-9fba-d79a5c8f790e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:21 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-43257de5-bd6a-4b4e-9fba-d79a5c8f790e Sep 10 19:57:21 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:21 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-43257de5-bd6a-4b4e-9fba-d79a5c8f790e" returned: 0 in 0.267s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:21 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:57:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1789ead3-5a25-4cc2-83a4-0321c5246ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43257de5-bd6a-4b4e-9fba-d79a5c8f790e', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df89e885-996b-4828-b32b-da347de697eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:21 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] Volume volume-43257de5-bd6a-4b4e-9fba-d79a5c8f790e (43257de5-bd6a-4b4e-9fba-d79a5c8f790e): created successfully Sep 10 19:57:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df89e885-996b-4828-b32b-da347de697eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] Flow 'volume_create_manager' (d85e9669-afd1-424c-82ca-5a2a2ad476b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:57:21 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-f80d74d1-fc64-4c27-ad7a-30118cbfaabe tempest-TestServerVolumeAttachmentScenario-29456212 None] Created volume successfully. Sep 10 19:57:31 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=64,cinder:UPDATE=91,cinder:INSERT=22,cinder:DELETE=10 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:57:31 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=75,cinder:UPDATE=96,cinder:DELETE=7,cinder:INSERT=22 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:57:38 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:57:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] Flow 'volume_create_manager' (b1876c6b-cd79-46ed-ac73-b33de7cd3511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:57:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae0db8a-5480-40f6-8655-f3dffd0bbf63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae0db8a-5480-40f6-8655-f3dffd0bbf63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-546443399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eec03d6-3346-478b-807b-413c1a033c9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03dd1a756c324096b05d9bc463717fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:57:39Z,use_quota=True,user_id='b5650f58632b4e7eb8f0cbc634d9bfbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fe59109-ab5d-4fa8-a0d2-f75e199dfba0),volume_type_id=7fe59109-ab5d-4fa8-a0d2-f75e199dfba0)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f75082f-d4da-4938-89cd-91d6382aa2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f75082f-d4da-4938-89cd-91d6382aa2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8471ae5e-7a35-43d0-8ac3-00b965f92de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8471ae5e-7a35-43d0-8ac3-00b965f92de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eec03d6-3346-478b-807b-413c1a033c9e', 'volume_name': 'volume-5eec03d6-3346-478b-807b-413c1a033c9e', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a078be0-67db-4dd7-b8a7-6f693ca1d08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a078be0-67db-4dd7-b8a7-6f693ca1d08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ea072a0-7d3e-4abe-af57-d8fd18402e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:38 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] Volume 5eec03d6-3346-478b-807b-413c1a033c9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eec03d6-3346-478b-807b-413c1a033c9e', 'volume_size': 1} Sep 10 19:57:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:38 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-546443399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eec03d6-3346-478b-807b-413c1a033c9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03dd1a756c324096b05d9bc463717fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:57:39Z,use_quota=True,user_id='b5650f58632b4e7eb8f0cbc634d9bfbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fe59109-ab5d-4fa8-a0d2-f75e199dfba0),volume_type_id=7fe59109-ab5d-4fa8-a0d2-f75e199dfba0)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:57:38 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] Creating volume 5eec03d6-3346-478b-807b-413c1a033c9e {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:57:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:38 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:57:38 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:57:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:38 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:57:38 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:57:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5eec03d6-3346-478b-807b-413c1a033c9e 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:38 devstack sudo[102894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5eec03d6-3346-478b-807b-413c1a033c9e 1073741824 Sep 10 19:57:38 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:39 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:57:39 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:39 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] Flow 'volume_create_manager' (77a8ce8b-6870-415a-b355-47a8eb90ecc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:57:39 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad91b80a-6c24-40b0-bab9-e39f32a35803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5eec03d6-3346-478b-807b-413c1a033c9e 1073741824" returned: 0 in 0.950s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:39 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad91b80a-6c24-40b0-bab9-e39f32a35803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1912332492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbdc1d21-39e6-4d6e-b2ec-90c58f69684e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03dd1a756c324096b05d9bc463717fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:57:39Z,use_quota=True,user_id='b5650f58632b4e7eb8f0cbc634d9bfbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3835a22-fd69-45d3-a958-086b2abeafb6),volume_type_id=b3835a22-fd69-45d3-a958-086b2abeafb6)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:39 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63e2735-87bc-49cb-932f-429544e64e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:39 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63e2735-87bc-49cb-932f-429544e64e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:39 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acf7192b-4858-4525-ad5b-c47be26eb31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:39 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acf7192b-4858-4525-ad5b-c47be26eb31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbdc1d21-39e6-4d6e-b2ec-90c58f69684e', 'volume_name': 'volume-cbdc1d21-39e6-4d6e-b2ec-90c58f69684e', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:39 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9074b00-4986-4be1-8fec-0e45a11b948c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:39 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9074b00-4986-4be1-8fec-0e45a11b948c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:39 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba91d23-0ca7-46d7-abad-2a23557bc473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:39 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] Volume cbdc1d21-39e6-4d6e-b2ec-90c58f69684e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbdc1d21-39e6-4d6e-b2ec-90c58f69684e', 'volume_size': 1} Sep 10 19:57:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] Flow 'volume_create_manager' (8596d368-3961-4bcd-9d34-79b8ffe2838e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2979f9bc-b426-4558-a784-133be9b059b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2979f9bc-b426-4558-a784-133be9b059b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1295409654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade21998-ac0a-4cd4-b73a-bf76a83fb12d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd7ba3eef1e44d3933c1c6ead58b668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:57:40Z,use_quota=True,user_id='e02cd833b7f6425ba6357e1d9b01e6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2bcf9ac-5508-441a-a601-db7196505622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2bcf9ac-5508-441a-a601-db7196505622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461dfc28-aa29-4815-9a3d-22005816e11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461dfc28-aa29-4815-9a3d-22005816e11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ade21998-ac0a-4cd4-b73a-bf76a83fb12d', 'volume_name': 'volume-ade21998-ac0a-4cd4-b73a-bf76a83fb12d', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (610b94af-f326-4389-a409-bf6c6e71b90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (610b94af-f326-4389-a409-bf6c6e71b90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9cce78b-8d33-4f66-ae70-ae1c521a60fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:40 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] Volume ade21998-ac0a-4cd4-b73a-bf76a83fb12d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ade21998-ac0a-4cd4-b73a-bf76a83fb12d', 'volume_size': 1} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5eec03d6-3346-478b-807b-413c1a033c9e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:40 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5eec03d6-3346-478b-807b-413c1a033c9e Sep 10 19:57:40 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Flow 'volume_create_manager' (93b27e6e-088a-49c7-b0c1-4cfc093461fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a4493f-e691-4ef1-9022-705125f7e1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a4493f-e691-4ef1-9022-705125f7e1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1944563758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36759c7f-97b4-4a2b-87c1-d409dc728442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03dd1a756c324096b05d9bc463717fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:57:40Z,use_quota=True,user_id='b5650f58632b4e7eb8f0cbc634d9bfbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d7053d8-681a-4088-8e6f-c8d5d822b8c3),volume_type_id=0d7053d8-681a-4088-8e6f-c8d5d822b8c3)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4411340-2510-4d84-ac7d-0ec1fae8468e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4411340-2510-4d84-ac7d-0ec1fae8468e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce41c268-1dbe-4332-9359-dd9f838a4c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG cinder.image.glance [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Creating Keystone auth plugin from conf {{(pid=88093) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 19:57:40 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5eec03d6-3346-478b-807b-413c1a033c9e" returned: 0 in 0.333s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.627s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1912332492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbdc1d21-39e6-4d6e-b2ec-90c58f69684e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03dd1a756c324096b05d9bc463717fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:57:39Z,use_quota=True,user_id='b5650f58632b4e7eb8f0cbc634d9bfbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3835a22-fd69-45d3-a958-086b2abeafb6),volume_type_id=b3835a22-fd69-45d3-a958-086b2abeafb6)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] Creating volume cbdc1d21-39e6-4d6e-b2ec-90c58f69684e {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:57:40 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-cbdc1d21-39e6-4d6e-b2ec-90c58f69684e 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:40 devstack sudo[102906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-cbdc1d21-39e6-4d6e-b2ec-90c58f69684e 1073741824 Sep 10 19:57:40 devstack sudo[102906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ea072a0-7d3e-4abe-af57-d8fd18402e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eec03d6-3346-478b-807b-413c1a033c9e', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (421fa4f4-c88f-4cf9-9791-144197556737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:40 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] Volume volume-5eec03d6-3346-478b-807b-413c1a033c9e (5eec03d6-3346-478b-807b-413c1a033c9e): created successfully Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (421fa4f4-c88f-4cf9-9791-144197556737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] Flow 'volume_create_manager' (b1876c6b-cd79-46ed-ac73-b33de7cd3511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:57:40 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-3a363d9c-9742-498b-8f8f-b5fd6c756953 tempest-TestInstancesWithCinderVolumes-2036485936 None] Created volume successfully. Sep 10 19:57:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce41c268-1dbe-4332-9359-dd9f838a4c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '36759c7f-97b4-4a2b-87c1-d409dc728442', 'volume_name': 'volume-36759c7f-97b4-4a2b-87c1-d409dc728442', 'volume_size': 1, 'image_id': '9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1774843682', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '03dd1a756c324096b05d9bc463717fd7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665', 'created_at': datetime.datetime(2026, 9, 10, 17, 57, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 57, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665/file', 'properties': {}}, 'image_service': }' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7118c227-f4fc-4037-9c9f-4ad6e06e9287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7118c227-f4fc-4037-9c9f-4ad6e06e9287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f190c841-2d04-4be6-aa9e-ea7b435ab711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:41 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Volume 36759c7f-97b4-4a2b-87c1-d409dc728442: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-36759c7f-97b4-4a2b-87c1-d409dc728442', 'volume_size': 1, 'image_id': '9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1774843682', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '03dd1a756c324096b05d9bc463717fd7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665', 'created_at': datetime.datetime(2026, 9, 10, 17, 57, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 57, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665/file', 'properties': {}}, 'image_service': } Sep 10 19:57:41 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Trying to clone 36759c7f-97b4-4a2b-87c1-d409dc728442 from image 9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665', 'metadata': {}}]). {{(pid=88093) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 19:57:41 devstack sudo[102906]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-cbdc1d21-39e6-4d6e-b2ec-90c58f69684e 1073741824" returned: 0 in 0.650s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-cbdc1d21-39e6-4d6e-b2ec-90c58f69684e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:41 devstack sudo[102912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-cbdc1d21-39e6-4d6e-b2ec-90c58f69684e Sep 10 19:57:41 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:41 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-cbdc1d21-39e6-4d6e-b2ec-90c58f69684e" returned: 0 in 0.311s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:57:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.387s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1295409654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade21998-ac0a-4cd4-b73a-bf76a83fb12d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd7ba3eef1e44d3933c1c6ead58b668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:57:40Z,use_quota=True,user_id='e02cd833b7f6425ba6357e1d9b01e6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:57:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] Creating volume ade21998-ac0a-4cd4-b73a-bf76a83fb12d {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:57:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:57:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:57:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:57:41 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:57:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ade21998-ac0a-4cd4-b73a-bf76a83fb12d 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:41 devstack sudo[102915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ade21998-ac0a-4cd4-b73a-bf76a83fb12d 1073741824 Sep 10 19:57:41 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba91d23-0ca7-46d7-abad-2a23557bc473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbdc1d21-39e6-4d6e-b2ec-90c58f69684e', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2abfd64-a6b8-4fc6-9778-4498c7946cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:41 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] Volume volume-cbdc1d21-39e6-4d6e-b2ec-90c58f69684e (cbdc1d21-39e6-4d6e-b2ec-90c58f69684e): created successfully Sep 10 19:57:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2abfd64-a6b8-4fc6-9778-4498c7946cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] Flow 'volume_create_manager' (77a8ce8b-6870-415a-b355-47a8eb90ecc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:57:41 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-242ce67d-ec06-4759-986b-55bfc3d0be35 tempest-TestInstancesWithCinderVolumes-2036485936 None] Created volume successfully. Sep 10 19:57:42 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ade21998-ac0a-4cd4-b73a-bf76a83fb12d 1073741824" returned: 0 in 0.537s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ade21998-ac0a-4cd4-b73a-bf76a83fb12d {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:42 devstack sudo[102921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ade21998-ac0a-4cd4-b73a-bf76a83fb12d Sep 10 19:57:42 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:42 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ade21998-ac0a-4cd4-b73a-bf76a83fb12d" returned: 0 in 0.301s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:42 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:57:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9cce78b-8d33-4f66-ae70-ae1c521a60fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ade21998-ac0a-4cd4-b73a-bf76a83fb12d', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f41167-f05d-4db3-a22c-fc7668e9c3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:42 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] Volume volume-ade21998-ac0a-4cd4-b73a-bf76a83fb12d (ade21998-ac0a-4cd4-b73a-bf76a83fb12d): created successfully Sep 10 19:57:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f41167-f05d-4db3-a22c-fc7668e9c3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] Flow 'volume_create_manager' (8596d368-3961-4bcd-9d34-79b8ffe2838e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:57:42 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-8e31ad2c-651c-44a6-a6c5-f0cfe648d2d9 tempest-VolumesListAdminTestJSON-997281232 None] Created volume successfully. Sep 10 19:57:44 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:57:44 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] Flow 'volume_create_manager' (49cdd006-6b06-4bdc-a3e0-9a38682500d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:57:44 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f67b3500-9f1a-4407-afb1-fcd73cb0c788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:44 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f67b3500-9f1a-4407-afb1-fcd73cb0c788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2109097219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c58f7c8e-2c1d-439c-a0d3-1b31b465e7ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd7ba3eef1e44d3933c1c6ead58b668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:57:44Z,use_quota=True,user_id='e02cd833b7f6425ba6357e1d9b01e6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:44 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f328824-88f6-46bb-8834-a7255f0620d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:44 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f328824-88f6-46bb-8834-a7255f0620d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:44 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c11fecc2-bbc2-4ed6-adb8-6f9b1356d0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:44 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c11fecc2-bbc2-4ed6-adb8-6f9b1356d0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c58f7c8e-2c1d-439c-a0d3-1b31b465e7ea', 'volume_name': 'volume-c58f7c8e-2c1d-439c-a0d3-1b31b465e7ea', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:44 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2718c1aa-76ce-48de-b15e-00aaa1b83be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:44 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2718c1aa-76ce-48de-b15e-00aaa1b83be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:44 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e4c8f6-92eb-476c-9122-f854d7a5b72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:44 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] Volume c58f7c8e-2c1d-439c-a0d3-1b31b465e7ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c58f7c8e-2c1d-439c-a0d3-1b31b465e7ea', 'volume_size': 1} Sep 10 19:57:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:44 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2109097219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c58f7c8e-2c1d-439c-a0d3-1b31b465e7ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd7ba3eef1e44d3933c1c6ead58b668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:57:44Z,use_quota=True,user_id='e02cd833b7f6425ba6357e1d9b01e6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:57:44 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] Creating volume c58f7c8e-2c1d-439c-a0d3-1b31b465e7ea {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:57:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:44 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:57:44 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:57:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:44 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:57:44 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:57:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c58f7c8e-2c1d-439c-a0d3-1b31b465e7ea 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:44 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c58f7c8e-2c1d-439c-a0d3-1b31b465e7ea 1073741824 Sep 10 19:57:44 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:44 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665_l4f9mmwtdevstack@QuobyteHD, size 20.69 MB, duration 3.74 sec {{(pid=88093) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 19:57:44 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Image download 20.69 MB at 5.53 MB/s Sep 10 19:57:44 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[5613f42a-d9f8-46af-9f31-f18c539ce031]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:57:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665_l4f9mmwtdevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:44 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c58f7c8e-2c1d-439c-a0d3-1b31b465e7ea 1073741824" returned: 0 in 0.484s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:44 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665_l4f9mmwtdevstack@QuobyteHD Sep 10 19:57:44 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c58f7c8e-2c1d-439c-a0d3-1b31b465e7ea {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:44 devstack sudo[102932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c58f7c8e-2c1d-439c-a0d3-1b31b465e7ea Sep 10 19:57:45 devstack sudo[102932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:45 devstack sudo[102932]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:45 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c58f7c8e-2c1d-439c-a0d3-1b31b465e7ea" returned: 0 in 0.265s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:57:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665_l4f9mmwtdevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:45 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Temporary image 9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665 is fetched for user b5650f58632b4e7eb8f0cbc634d9bfbf. {{(pid=88093) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 19:57:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e4c8f6-92eb-476c-9122-f854d7a5b72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c58f7c8e-2c1d-439c-a0d3-1b31b465e7ea', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac63353-b821-48bf-91e7-e42403dda0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:45 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] Volume volume-c58f7c8e-2c1d-439c-a0d3-1b31b465e7ea (c58f7c8e-2c1d-439c-a0d3-1b31b465e7ea): created successfully Sep 10 19:57:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac63353-b821-48bf-91e7-e42403dda0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] Flow 'volume_create_manager' (49cdd006-6b06-4bdc-a3e0-9a38682500d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:57:45 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-82066ef6-5331-42df-a0ea-d504ba19cd24 tempest-VolumesListAdminTestJSON-997281232 None] Created volume successfully. Sep 10 19:57:45 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e79847-06c7-47c7-bee2-c7046ee5c689]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:57:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665_l4f9mmwtdevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:45 devstack sudo[102938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665_l4f9mmwtdevstack@QuobyteHD Sep 10 19:57:45 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:45 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665_l4f9mmwtdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1944563758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36759c7f-97b4-4a2b-87c1-d409dc728442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03dd1a756c324096b05d9bc463717fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:57:40Z,use_quota=True,user_id='b5650f58632b4e7eb8f0cbc634d9bfbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d7053d8-681a-4088-8e6f-c8d5d822b8c3),volume_type_id=0d7053d8-681a-4088-8e6f-c8d5d822b8c3)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:57:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Creating volume 36759c7f-97b4-4a2b-87c1-d409dc728442 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:57:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:57:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:57:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:57:45 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:57:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-36759c7f-97b4-4a2b-87c1-d409dc728442 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:45 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-36759c7f-97b4-4a2b-87c1-d409dc728442 1073741824 Sep 10 19:57:45 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:46 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-36759c7f-97b4-4a2b-87c1-d409dc728442 1073741824" returned: 0 in 0.479s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-36759c7f-97b4-4a2b-87c1-d409dc728442 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:46 devstack sudo[102948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-36759c7f-97b4-4a2b-87c1-d409dc728442 Sep 10 19:57:46 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:46 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-36759c7f-97b4-4a2b-87c1-d409dc728442" returned: 0 in 0.316s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:46 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:57:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:46 devstack cinder-volume[88093]: DEBUG cinder.volume.volume_utils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Attempting download of 9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665 ((None, [{'url': 'file:///opt/stack/data/glance/images/9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665', 'metadata': {}}])) to volume 36759c7f-97b4-4a2b-87c1-d409dc728442. {{(pid=88093) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 19:57:46 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efc47bd-b705-4dac-86fa-22b072db2919]: (4, 'raw') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:57:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665_9ywgv6lc {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:46 devstack sudo[102951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665_9ywgv6lc Sep 10 19:57:46 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] Flow 'volume_create_manager' (c9db2dbb-12c4-463f-b32c-1909dde0dbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:57:47 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (563a7871-e341-46fa-b5f8-464ef2208748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665_9ywgv6lc" returned: 0 in 0.412s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665_9ywgv6lc {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (563a7871-e341-46fa-b5f8-464ef2208748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2008476675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b121c2-ccac-41c4-ad48-e8f8dc9eab7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd7ba3eef1e44d3933c1c6ead58b668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:57:47Z,use_quota=True,user_id='e02cd833b7f6425ba6357e1d9b01e6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e9ff29-c4d6-492c-a6c5-4acc3d81bec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e9ff29-c4d6-492c-a6c5-4acc3d81bec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (817d8a75-33c5-4928-a5c2-fa1bddea83fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (817d8a75-33c5-4928-a5c2-fa1bddea83fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01b121c2-ccac-41c4-ad48-e8f8dc9eab7a', 'volume_name': 'volume-01b121c2-ccac-41c4-ad48-e8f8dc9eab7a', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e52a37-93fa-4217-b40d-39ec5ac8686a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e52a37-93fa-4217-b40d-39ec5ac8686a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (957a23fc-25e0-429d-b44e-39c06c422db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:47 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] Volume 01b121c2-ccac-41c4-ad48-e8f8dc9eab7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01b121c2-ccac-41c4-ad48-e8f8dc9eab7a', 'volume_size': 1} Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2008476675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b121c2-ccac-41c4-ad48-e8f8dc9eab7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd7ba3eef1e44d3933c1c6ead58b668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:57:47Z,use_quota=True,user_id='e02cd833b7f6425ba6357e1d9b01e6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] Creating volume 01b121c2-ccac-41c4-ad48-e8f8dc9eab7a {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:57:47 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-01b121c2-ccac-41c4-ad48-e8f8dc9eab7a 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:47 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-01b121c2-ccac-41c4-ad48-e8f8dc9eab7a 1073741824 Sep 10 19:57:47 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:47 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665_9ywgv6lc Sep 10 19:57:47 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:47 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665_9ywgv6lc" returned: 1 in 0.399s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665_9ywgv6lc' failed. Not Retrying. {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc28664d-395d-49ed-bfa7-49696331d085]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665_l4f9mmwtdevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:47 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665_l4f9mmwtdevstack@QuobyteHD Sep 10 19:57:47 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:47 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-01b121c2-ccac-41c4-ad48-e8f8dc9eab7a 1073741824" returned: 0 in 0.481s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-01b121c2-ccac-41c4-ad48-e8f8dc9eab7a {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:47 devstack sudo[102972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-01b121c2-ccac-41c4-ad48-e8f8dc9eab7a Sep 10 19:57:47 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:47 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665_l4f9mmwtdevstack@QuobyteHD" returned: 0 in 0.437s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] 9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665 was qcow2, converting to qcow2 {{(pid=88093) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 19:57:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665_l4f9mmwtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-36759c7f-97b4-4a2b-87c1-d409dc728442 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:47 devstack sudo[102977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665_l4f9mmwtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-36759c7f-97b4-4a2b-87c1-d409dc728442 Sep 10 19:57:48 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:48 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-01b121c2-ccac-41c4-ad48-e8f8dc9eab7a" returned: 0 in 0.294s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:48 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:57:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (957a23fc-25e0-429d-b44e-39c06c422db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01b121c2-ccac-41c4-ad48-e8f8dc9eab7a', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f055686a-aa48-4d16-850d-1ec2d55296ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:48 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] Volume volume-01b121c2-ccac-41c4-ad48-e8f8dc9eab7a (01b121c2-ccac-41c4-ad48-e8f8dc9eab7a): created successfully Sep 10 19:57:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f055686a-aa48-4d16-850d-1ec2d55296ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] Flow 'volume_create_manager' (c9db2dbb-12c4-463f-b32c-1909dde0dbfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:57:48 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-7952f810-7a7f-42c0-8533-a30c219be909 tempest-VolumesListAdminTestJSON-997281232 None] Created volume successfully. Sep 10 19:57:50 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665_l4f9mmwtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-36759c7f-97b4-4a2b-87c1-d409dc728442" returned: 0 in 2.062s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665_l4f9mmwtdevstack@QuobyteHD, size 112.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-36759c7f-97b4-4a2b-87c1-d409dc728442 {{(pid=88093) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 19:57:50 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Converted 112.00 MB image at 54.28 MB/s Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-36759c7f-97b4-4a2b-87c1-d409dc728442 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:50 devstack sudo[103008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-36759c7f-97b4-4a2b-87c1-d409dc728442 1G Sep 10 19:57:50 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] Flow 'volume_create_manager' (9389ad52-3f64-48ee-a51f-c2171c86b08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f48375f2-1fe8-4a51-930e-43be5d671b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f48375f2-1fe8-4a51-930e-43be5d671b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00ed3a29-8c8c-419c-9425-019c82943f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ba79bd94724becb782b56d27b70d38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:57:50Z,use_quota=True,user_id='a5419a72b00b41c2957938b1195aae75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908e2714-1414-4060-bf0c-49ec725df417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908e2714-1414-4060-bf0c-49ec725df417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5281a98a-4d41-43ea-962d-bd9cdcf96970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5281a98a-4d41-43ea-962d-bd9cdcf96970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00ed3a29-8c8c-419c-9425-019c82943f3e', 'volume_name': 'volume-00ed3a29-8c8c-419c-9425-019c82943f3e', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24de1b4c-96c1-4bc7-9edf-71212ab5fe47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24de1b4c-96c1-4bc7-9edf-71212ab5fe47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ceb984-a42c-433b-9b0a-5e05aebe2303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:50 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] Volume 00ed3a29-8c8c-419c-9425-019c82943f3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00ed3a29-8c8c-419c-9425-019c82943f3e', 'volume_size': 1} Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00ed3a29-8c8c-419c-9425-019c82943f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ba79bd94724becb782b56d27b70d38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:57:50Z,use_quota=True,user_id='a5419a72b00b41c2957938b1195aae75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] Creating volume 00ed3a29-8c8c-419c-9425-019c82943f3e {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:57:50 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-00ed3a29-8c8c-419c-9425-019c82943f3e 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:50 devstack sudo[103013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-00ed3a29-8c8c-419c-9425-019c82943f3e 1073741824 Sep 10 19:57:50 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:50 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-36759c7f-97b4-4a2b-87c1-d409dc728442 1G" returned: 0 in 0.406s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG cinder.volume.volume_utils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Downloaded image 9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665 ((None, [{'url': 'file:///opt/stack/data/glance/images/9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665', 'metadata': {}}])) to volume 36759c7f-97b4-4a2b-87c1-d409dc728442 successfully. {{(pid=88093) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Temporary image 9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665 for user b5650f58632b4e7eb8f0cbc634d9bfbf is deleted. {{(pid=88093) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG cinder.volume.volume_utils [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Marking volume 36759c7f-97b4-4a2b-87c1-d409dc728442 as bootable. {{(pid=88093) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Copying metadata from image 9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665 to 36759c7f-97b4-4a2b-87c1-d409dc728442. {{(pid=88093) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Creating volume glance metadata for volume 36759c7f-97b4-4a2b-87c1-d409dc728442 backed by image 9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665 with: {'image_id': '9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665', 'image_name': 'tempest-scenario-img--1774843682', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88093) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f190c841-2d04-4be6-aa9e-ea7b435ab711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36759c7f-97b4-4a2b-87c1-d409dc728442', 'volume_size': 1, 'image_id': '9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1774843682', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '03dd1a756c324096b05d9bc463717fd7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665', 'created_at': datetime.datetime(2026, 9, 10, 17, 57, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 57, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ac77ab2-90e2-4e4b-af6e-75ef0b8b2665/file', 'properties': {}}, 'image_service': }' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e325cd6-32d4-4bad-9fd4-5199124ce584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:50 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Volume volume-36759c7f-97b4-4a2b-87c1-d409dc728442 (36759c7f-97b4-4a2b-87c1-d409dc728442): created successfully Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e325cd6-32d4-4bad-9fd4-5199124ce584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Flow 'volume_create_manager' (93b27e6e-088a-49c7-b0c1-4cfc093461fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:57:50 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-6525876e-92aa-4888-b8a1-b4326ffc03ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Created volume successfully. Sep 10 19:57:50 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-00ed3a29-8c8c-419c-9425-019c82943f3e 1073741824" returned: 0 in 0.429s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-00ed3a29-8c8c-419c-9425-019c82943f3e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:50 devstack sudo[103020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-00ed3a29-8c8c-419c-9425-019c82943f3e Sep 10 19:57:50 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:51 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-00ed3a29-8c8c-419c-9425-019c82943f3e" returned: 0 in 0.278s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:57:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ceb984-a42c-433b-9b0a-5e05aebe2303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00ed3a29-8c8c-419c-9425-019c82943f3e', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (579f6c52-05f5-4541-bccd-fac04e867cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:57:51 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] Volume volume-00ed3a29-8c8c-419c-9425-019c82943f3e (00ed3a29-8c8c-419c-9425-019c82943f3e): created successfully Sep 10 19:57:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (579f6c52-05f5-4541-bccd-fac04e867cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:57:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] Flow 'volume_create_manager' (9389ad52-3f64-48ee-a51f-c2171c86b08c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:57:51 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-9bed76eb-edda-4357-9a69-0d404a8657ad tempest-VolumesListAdminTestJSON-1444022608 None] Created volume successfully. Sep 10 19:57:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e88d880d-be22-4649-bfcd-150d92474101 tempest-VolumesListAdminTestJSON-1444022608 None] Acquiring lock "cinder-00ed3a29-8c8c-419c-9425-019c82943f3e-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:57:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e88d880d-be22-4649-bfcd-150d92474101 tempest-VolumesListAdminTestJSON-1444022608 None] Lock "cinder-00ed3a29-8c8c-419c-9425-019c82943f3e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:57:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e88d880d-be22-4649-bfcd-150d92474101 tempest-VolumesListAdminTestJSON-1444022608 None] Acquiring lock "cinder-quobyte-00ed3a29-8c8c-419c-9425-019c82943f3e" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:57:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e88d880d-be22-4649-bfcd-150d92474101 tempest-VolumesListAdminTestJSON-1444022608 None] Lock "cinder-quobyte-00ed3a29-8c8c-419c-9425-019c82943f3e" acquired by "delete_volume" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:57:51 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d1be14-107f-4f97-b1d9-81fba3e67b5e]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:57:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e88d880d-be22-4649-bfcd-150d92474101 tempest-VolumesListAdminTestJSON-1444022608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-00ed3a29-8c8c-419c-9425-019c82943f3e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d6511f45-080e-45d8-8168-1374fafc53b6 tempest-VolumesListAdminTestJSON-997281232 None] Acquiring lock "cinder-01b121c2-ccac-41c4-ad48-e8f8dc9eab7a-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:57:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d6511f45-080e-45d8-8168-1374fafc53b6 tempest-VolumesListAdminTestJSON-997281232 None] Lock "cinder-01b121c2-ccac-41c4-ad48-e8f8dc9eab7a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:57:51 devstack sudo[103023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-00ed3a29-8c8c-419c-9425-019c82943f3e Sep 10 19:57:51 devstack sudo[103023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d6511f45-080e-45d8-8168-1374fafc53b6 tempest-VolumesListAdminTestJSON-997281232 None] Acquiring lock "cinder-quobyte-01b121c2-ccac-41c4-ad48-e8f8dc9eab7a" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:57:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d6511f45-080e-45d8-8168-1374fafc53b6 tempest-VolumesListAdminTestJSON-997281232 None] Lock "cinder-quobyte-01b121c2-ccac-41c4-ad48-e8f8dc9eab7a" acquired by "delete_volume" :: waited 0.015s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:57:51 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[e594c057-88eb-4210-a2b8-82a0524da7c3]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:57:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d6511f45-080e-45d8-8168-1374fafc53b6 tempest-VolumesListAdminTestJSON-997281232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-01b121c2-ccac-41c4-ad48-e8f8dc9eab7a {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:51 devstack sudo[103025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-01b121c2-ccac-41c4-ad48-e8f8dc9eab7a Sep 10 19:57:51 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:51 devstack sudo[103023]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e88d880d-be22-4649-bfcd-150d92474101 tempest-VolumesListAdminTestJSON-1444022608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-00ed3a29-8c8c-419c-9425-019c82943f3e" returned: 0 in 0.440s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e88d880d-be22-4649-bfcd-150d92474101 tempest-VolumesListAdminTestJSON-1444022608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-00ed3a29-8c8c-419c-9425-019c82943f3e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:51 devstack sudo[103030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-00ed3a29-8c8c-419c-9425-019c82943f3e Sep 10 19:57:51 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:52 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d6511f45-080e-45d8-8168-1374fafc53b6 tempest-VolumesListAdminTestJSON-997281232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-01b121c2-ccac-41c4-ad48-e8f8dc9eab7a" returned: 0 in 0.443s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d6511f45-080e-45d8-8168-1374fafc53b6 tempest-VolumesListAdminTestJSON-997281232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-01b121c2-ccac-41c4-ad48-e8f8dc9eab7a {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:52 devstack sudo[103035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-01b121c2-ccac-41c4-ad48-e8f8dc9eab7a Sep 10 19:57:52 devstack sudo[103035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:52 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e88d880d-be22-4649-bfcd-150d92474101 tempest-VolumesListAdminTestJSON-1444022608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-00ed3a29-8c8c-419c-9425-019c82943f3e" returned: 0 in 0.331s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e88d880d-be22-4649-bfcd-150d92474101 tempest-VolumesListAdminTestJSON-1444022608 None] Lock "cinder-quobyte-00ed3a29-8c8c-419c-9425-019c82943f3e" released by "delete_volume" :: held 0.830s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:57:52 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-e88d880d-be22-4649-bfcd-150d92474101 tempest-VolumesListAdminTestJSON-1444022608 None] Created reservations ['edf65fc0-ed39-4a8f-83bd-5dfa64f98c56', '9c33ec89-5719-4a2c-82d9-cac703bd6997', '89fd6954-4efc-4349-b441-a417cad19c91', '2d5a1f22-3097-4ed0-96ca-3ae2541f606c'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:57:52 devstack sudo[103035]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d6511f45-080e-45d8-8168-1374fafc53b6 tempest-VolumesListAdminTestJSON-997281232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-01b121c2-ccac-41c4-ad48-e8f8dc9eab7a" returned: 0 in 0.312s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d6511f45-080e-45d8-8168-1374fafc53b6 tempest-VolumesListAdminTestJSON-997281232 None] Lock "cinder-quobyte-01b121c2-ccac-41c4-ad48-e8f8dc9eab7a" released by "delete_volume" :: held 0.808s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:57:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e88d880d-be22-4649-bfcd-150d92474101 tempest-VolumesListAdminTestJSON-1444022608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e88d880d-be22-4649-bfcd-150d92474101 tempest-VolumesListAdminTestJSON-1444022608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:52 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e88d880d-be22-4649-bfcd-150d92474101 tempest-VolumesListAdminTestJSON-1444022608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:57:52 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e88d880d-be22-4649-bfcd-150d92474101 tempest-VolumesListAdminTestJSON-1444022608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:57:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e88d880d-be22-4649-bfcd-150d92474101 tempest-VolumesListAdminTestJSON-1444022608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e88d880d-be22-4649-bfcd-150d92474101 tempest-VolumesListAdminTestJSON-1444022608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:52 devstack sudo[103042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:57:52 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:52 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-d6511f45-080e-45d8-8168-1374fafc53b6 tempest-VolumesListAdminTestJSON-997281232 None] Created reservations ['2c440d86-c2f8-4100-bcde-d79212327b30', '9a18997e-536a-4d2e-9440-a9f9ecdd4780', '11895be1-e8f3-4ce2-8f2e-3f46446bbf77', 'b8d14879-f3ff-4e6f-993a-85ceed219fc3'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:57:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d6511f45-080e-45d8-8168-1374fafc53b6 tempest-VolumesListAdminTestJSON-997281232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d6511f45-080e-45d8-8168-1374fafc53b6 tempest-VolumesListAdminTestJSON-997281232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:52 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d6511f45-080e-45d8-8168-1374fafc53b6 tempest-VolumesListAdminTestJSON-997281232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:57:52 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d6511f45-080e-45d8-8168-1374fafc53b6 tempest-VolumesListAdminTestJSON-997281232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:57:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d6511f45-080e-45d8-8168-1374fafc53b6 tempest-VolumesListAdminTestJSON-997281232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d6511f45-080e-45d8-8168-1374fafc53b6 tempest-VolumesListAdminTestJSON-997281232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:52 devstack sudo[103044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:57:52 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:52 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e88d880d-be22-4649-bfcd-150d92474101 tempest-VolumesListAdminTestJSON-1444022608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.316s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:52 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-e88d880d-be22-4649-bfcd-150d92474101 tempest-VolumesListAdminTestJSON-1444022608 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:57:52 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-e88d880d-be22-4649-bfcd-150d92474101 tempest-VolumesListAdminTestJSON-1444022608 None] Deleted volume successfully. Sep 10 19:57:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a8b3a294-94be-42d7-aade-d0dbdec6f6ca tempest-VolumesListAdminTestJSON-997281232 None] Acquiring lock "cinder-c58f7c8e-2c1d-439c-a0d3-1b31b465e7ea-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:57:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a8b3a294-94be-42d7-aade-d0dbdec6f6ca tempest-VolumesListAdminTestJSON-997281232 None] Lock "cinder-c58f7c8e-2c1d-439c-a0d3-1b31b465e7ea-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:57:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e88d880d-be22-4649-bfcd-150d92474101 tempest-VolumesListAdminTestJSON-1444022608 None] Lock "cinder-00ed3a29-8c8c-419c-9425-019c82943f3e-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:57:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a8b3a294-94be-42d7-aade-d0dbdec6f6ca tempest-VolumesListAdminTestJSON-997281232 None] Acquiring lock "cinder-quobyte-c58f7c8e-2c1d-439c-a0d3-1b31b465e7ea" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:57:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a8b3a294-94be-42d7-aade-d0dbdec6f6ca tempest-VolumesListAdminTestJSON-997281232 None] Lock "cinder-quobyte-c58f7c8e-2c1d-439c-a0d3-1b31b465e7ea" acquired by "delete_volume" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:57:52 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d6511f45-080e-45d8-8168-1374fafc53b6 tempest-VolumesListAdminTestJSON-997281232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.302s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:52 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-d6511f45-080e-45d8-8168-1374fafc53b6 tempest-VolumesListAdminTestJSON-997281232 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:57:52 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-d6511f45-080e-45d8-8168-1374fafc53b6 tempest-VolumesListAdminTestJSON-997281232 None] Deleted volume successfully. Sep 10 19:57:52 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf04caa-5271-4346-8ed9-9584cad82fd8]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:57:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a8b3a294-94be-42d7-aade-d0dbdec6f6ca tempest-VolumesListAdminTestJSON-997281232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c58f7c8e-2c1d-439c-a0d3-1b31b465e7ea {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d6511f45-080e-45d8-8168-1374fafc53b6 tempest-VolumesListAdminTestJSON-997281232 None] Lock "cinder-01b121c2-ccac-41c4-ad48-e8f8dc9eab7a-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:57:53 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c58f7c8e-2c1d-439c-a0d3-1b31b465e7ea Sep 10 19:57:53 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:53 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a8b3a294-94be-42d7-aade-d0dbdec6f6ca tempest-VolumesListAdminTestJSON-997281232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c58f7c8e-2c1d-439c-a0d3-1b31b465e7ea" returned: 0 in 0.437s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a8b3a294-94be-42d7-aade-d0dbdec6f6ca tempest-VolumesListAdminTestJSON-997281232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c58f7c8e-2c1d-439c-a0d3-1b31b465e7ea {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:53 devstack sudo[103055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c58f7c8e-2c1d-439c-a0d3-1b31b465e7ea Sep 10 19:57:53 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:53 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a8b3a294-94be-42d7-aade-d0dbdec6f6ca tempest-VolumesListAdminTestJSON-997281232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c58f7c8e-2c1d-439c-a0d3-1b31b465e7ea" returned: 0 in 0.372s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a8b3a294-94be-42d7-aade-d0dbdec6f6ca tempest-VolumesListAdminTestJSON-997281232 None] Lock "cinder-quobyte-c58f7c8e-2c1d-439c-a0d3-1b31b465e7ea" released by "delete_volume" :: held 0.873s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:57:53 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-a8b3a294-94be-42d7-aade-d0dbdec6f6ca tempest-VolumesListAdminTestJSON-997281232 None] Created reservations ['8f0171a6-b22b-43cd-bbd8-245c5c441121', '0e455442-22c0-45c5-b24a-850b1602cd9d', 'aa83e4de-19ea-4f8c-99c1-8965826c2ad6', 'bfb4bebb-a6fe-4c7a-b092-0148b9aa1646'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:57:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a8b3a294-94be-42d7-aade-d0dbdec6f6ca tempest-VolumesListAdminTestJSON-997281232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a8b3a294-94be-42d7-aade-d0dbdec6f6ca tempest-VolumesListAdminTestJSON-997281232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:54 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a8b3a294-94be-42d7-aade-d0dbdec6f6ca tempest-VolumesListAdminTestJSON-997281232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:57:54 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a8b3a294-94be-42d7-aade-d0dbdec6f6ca tempest-VolumesListAdminTestJSON-997281232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:57:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a8b3a294-94be-42d7-aade-d0dbdec6f6ca tempest-VolumesListAdminTestJSON-997281232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a8b3a294-94be-42d7-aade-d0dbdec6f6ca tempest-VolumesListAdminTestJSON-997281232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:54 devstack sudo[103075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:57:54 devstack sudo[103075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:54 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-755a6b38-6290-4ccc-a6c0-2792861d8b16 tempest-VolumesListAdminTestJSON-997281232 None] Acquiring lock "cinder-ade21998-ac0a-4cd4-b73a-bf76a83fb12d-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:57:54 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-755a6b38-6290-4ccc-a6c0-2792861d8b16 tempest-VolumesListAdminTestJSON-997281232 None] Lock "cinder-ade21998-ac0a-4cd4-b73a-bf76a83fb12d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:57:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-5e217c02-aa42-4581-ad83-75d1686ae67e req-404180e6-7c22-4374-976f-4fd61b26c143 tempest-TestInstancesWithCinderVolumes-2036485936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-5e217c02-aa42-4581-ad83-75d1686ae67e req-404180e6-7c22-4374-976f-4fd61b26c143 tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-5e217c02-aa42-4581-ad83-75d1686ae67e req-404180e6-7c22-4374-976f-4fd61b26c143 tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:54 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-755a6b38-6290-4ccc-a6c0-2792861d8b16 tempest-VolumesListAdminTestJSON-997281232 None] Acquiring lock "cinder-quobyte-ade21998-ac0a-4cd4-b73a-bf76a83fb12d" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:57:54 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-755a6b38-6290-4ccc-a6c0-2792861d8b16 tempest-VolumesListAdminTestJSON-997281232 None] Lock "cinder-quobyte-ade21998-ac0a-4cd4-b73a-bf76a83fb12d" acquired by "delete_volume" :: waited 0.026s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:57:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-5e217c02-aa42-4581-ad83-75d1686ae67e req-404180e6-7c22-4374-976f-4fd61b26c143 tempest-TestInstancesWithCinderVolumes-2036485936 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3', 'name': 'volume-36759c7f-97b4-4a2b-87c1-d409dc728442', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e60f15e6-06bf-440c-829f-b248e07316ac', 'enforce_multipath': True} {{(pid=88093) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 19:57:54 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[100bf2ef-8b1d-41b3-a11c-9c87717f8255]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:57:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-755a6b38-6290-4ccc-a6c0-2792861d8b16 tempest-VolumesListAdminTestJSON-997281232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ade21998-ac0a-4cd4-b73a-bf76a83fb12d {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:54 devstack sudo[103075]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a8b3a294-94be-42d7-aade-d0dbdec6f6ca tempest-VolumesListAdminTestJSON-997281232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.441s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:54 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-a8b3a294-94be-42d7-aade-d0dbdec6f6ca tempest-VolumesListAdminTestJSON-997281232 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:57:54 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-a8b3a294-94be-42d7-aade-d0dbdec6f6ca tempest-VolumesListAdminTestJSON-997281232 None] Deleted volume successfully. Sep 10 19:57:54 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a8b3a294-94be-42d7-aade-d0dbdec6f6ca tempest-VolumesListAdminTestJSON-997281232 None] Lock "cinder-c58f7c8e-2c1d-439c-a0d3-1b31b465e7ea-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:57:54 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-5e217c02-aa42-4581-ad83-75d1686ae67e req-404180e6-7c22-4374-976f-4fd61b26c143 tempest-TestInstancesWithCinderVolumes-2036485936 None] attachment_update completed successfully. Sep 10 19:57:54 devstack sudo[103078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ade21998-ac0a-4cd4-b73a-bf76a83fb12d Sep 10 19:57:54 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:54 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-755a6b38-6290-4ccc-a6c0-2792861d8b16 tempest-VolumesListAdminTestJSON-997281232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ade21998-ac0a-4cd4-b73a-bf76a83fb12d" returned: 0 in 0.550s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-755a6b38-6290-4ccc-a6c0-2792861d8b16 tempest-VolumesListAdminTestJSON-997281232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ade21998-ac0a-4cd4-b73a-bf76a83fb12d {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:55 devstack sudo[103084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ade21998-ac0a-4cd4-b73a-bf76a83fb12d Sep 10 19:57:55 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:55 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-755a6b38-6290-4ccc-a6c0-2792861d8b16 tempest-VolumesListAdminTestJSON-997281232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ade21998-ac0a-4cd4-b73a-bf76a83fb12d" returned: 0 in 0.300s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:55 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-755a6b38-6290-4ccc-a6c0-2792861d8b16 tempest-VolumesListAdminTestJSON-997281232 None] Lock "cinder-quobyte-ade21998-ac0a-4cd4-b73a-bf76a83fb12d" released by "delete_volume" :: held 0.939s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:57:55 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-755a6b38-6290-4ccc-a6c0-2792861d8b16 tempest-VolumesListAdminTestJSON-997281232 None] Created reservations ['60115267-e6f9-47b8-bcd6-1aa5c8b09d01', '30d986a0-9566-4b5a-8dc7-f988849a47f8', '25d6e630-d46c-4ce7-bf0c-ccb09fa0e6bb', 'da473272-bd76-4deb-81fc-26c01008a48c'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:57:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-755a6b38-6290-4ccc-a6c0-2792861d8b16 tempest-VolumesListAdminTestJSON-997281232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:57:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-755a6b38-6290-4ccc-a6c0-2792861d8b16 tempest-VolumesListAdminTestJSON-997281232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:57:55 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-755a6b38-6290-4ccc-a6c0-2792861d8b16 tempest-VolumesListAdminTestJSON-997281232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:57:55 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-755a6b38-6290-4ccc-a6c0-2792861d8b16 tempest-VolumesListAdminTestJSON-997281232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:57:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-755a6b38-6290-4ccc-a6c0-2792861d8b16 tempest-VolumesListAdminTestJSON-997281232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:57:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-755a6b38-6290-4ccc-a6c0-2792861d8b16 tempest-VolumesListAdminTestJSON-997281232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:57:55 devstack sudo[103087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:57:55 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:57:55 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root Sep 10 19:57:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-755a6b38-6290-4ccc-a6c0-2792861d8b16 tempest-VolumesListAdminTestJSON-997281232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.266s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:57:55 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-755a6b38-6290-4ccc-a6c0-2792861d8b16 tempest-VolumesListAdminTestJSON-997281232 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:57:55 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-755a6b38-6290-4ccc-a6c0-2792861d8b16 tempest-VolumesListAdminTestJSON-997281232 None] Deleted volume successfully. Sep 10 19:57:55 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-755a6b38-6290-4ccc-a6c0-2792861d8b16 tempest-VolumesListAdminTestJSON-997281232 None] Lock "cinder-ade21998-ac0a-4cd4-b73a-bf76a83fb12d-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:58:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-d8872a02-b36e-41c3-950b-0b5c57d11b6d req-3355920a-d064-478d-94db-fb5f9ab15c50 tempest-TestServerVolumeAttachmentScenario-29456212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:58:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-d8872a02-b36e-41c3-950b-0b5c57d11b6d req-3355920a-d064-478d-94db-fb5f9ab15c50 tempest-TestServerVolumeAttachmentScenario-29456212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:58:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-d8872a02-b36e-41c3-950b-0b5c57d11b6d req-3355920a-d064-478d-94db-fb5f9ab15c50 tempest-TestServerVolumeAttachmentScenario-29456212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:58:02 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-d8872a02-b36e-41c3-950b-0b5c57d11b6d req-3355920a-d064-478d-94db-fb5f9ab15c50 tempest-TestServerVolumeAttachmentScenario-29456212 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3', 'name': 'volume-153c7dfc-f6ae-45e5-a128-52cf6f3e1742', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4f8953ab-a4e8-42a3-b2c8-7c0436f0a7c4', 'enforce_multipath': True} {{(pid=88093) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 19:58:02 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-d8872a02-b36e-41c3-950b-0b5c57d11b6d req-3355920a-d064-478d-94db-fb5f9ab15c50 tempest-TestServerVolumeAttachmentScenario-29456212 None] attachment_update completed successfully. Sep 10 19:58:03 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:58:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:58:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:58:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:58:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:58:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:58:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:04 devstack sudo[103556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:58:04 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.478s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:04 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:58:04 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:04 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager._thread_info {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:58:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread count: 28 {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 19:58:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread info: [<_MainThread(MainThread, started 138417491665024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 19:58:04 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:58:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] Flow 'volume_create_manager' (1e3fbbcb-62c6-4bc0-a195-369f8f2161a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:58:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e78ea8b-3cd0-4ec8-be82-c21cf5caeb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:58:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e78ea8b-3cd0-4ec8-be82-c21cf5caeb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1238131300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e875c7e6-2911-46ab-aa1f-4a86cec34076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2c35c0685b4039ae7c4b261cedae80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:58:05Z,use_quota=True,user_id='7e419f7cb3a3468f80e8f2fa9647957d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:58:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af6f592-0805-4498-b962-682d0c12524e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:58:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af6f592-0805-4498-b962-682d0c12524e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:58:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e75cfdc-bbdb-4625-9600-36ab61a84db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:58:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e75cfdc-bbdb-4625-9600-36ab61a84db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e875c7e6-2911-46ab-aa1f-4a86cec34076', 'volume_name': 'volume-e875c7e6-2911-46ab-aa1f-4a86cec34076', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:58:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4fab670-82b2-46f4-b798-776cbc33e40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:58:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4fab670-82b2-46f4-b798-776cbc33e40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:58:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d3ecd9-6db9-4cd6-9357-b033632e3eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:58:04 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] Volume e875c7e6-2911-46ab-aa1f-4a86cec34076: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e875c7e6-2911-46ab-aa1f-4a86cec34076', 'volume_size': 1} Sep 10 19:58:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:58:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:58:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1238131300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e875c7e6-2911-46ab-aa1f-4a86cec34076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2c35c0685b4039ae7c4b261cedae80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:58:05Z,use_quota=True,user_id='7e419f7cb3a3468f80e8f2fa9647957d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:58:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] Creating volume e875c7e6-2911-46ab-aa1f-4a86cec34076 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:58:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:58:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:58:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:58:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:58:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:58:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:58:04 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:58:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:04 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076 1073741824 Sep 10 19:58:04 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:05 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076 1073741824" returned: 0 in 0.955s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:05 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076 Sep 10 19:58:05 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:06 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076" returned: 0 in 0.455s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:06 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:58:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:58:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d3ecd9-6db9-4cd6-9357-b033632e3eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e875c7e6-2911-46ab-aa1f-4a86cec34076', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:58:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e017d1a2-b22d-45e1-a345-f9dcd486a85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:58:06 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] Volume volume-e875c7e6-2911-46ab-aa1f-4a86cec34076 (e875c7e6-2911-46ab-aa1f-4a86cec34076): created successfully Sep 10 19:58:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e017d1a2-b22d-45e1-a345-f9dcd486a85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:58:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] Flow 'volume_create_manager' (1e3fbbcb-62c6-4bc0-a195-369f8f2161a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:58:06 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-302a4154-563f-4588-8070-b6a98c8ee6c2 tempest-VolumesSnapshotListTestJSON-1034354756 None] Created volume successfully. Sep 10 19:58:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-94bde6ee-fc1a-4f32-9bfc-1819295539ca tempest-VolumesSnapshotListTestJSON-1034354756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:58:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-94bde6ee-fc1a-4f32-9bfc-1819295539ca tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:58:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-94bde6ee-fc1a-4f32-9bfc-1819295539ca tempest-VolumesSnapshotListTestJSON-1034354756 None] Creating offline snapshot f44a68c8-2a25-4231-986a-9b7c5fd9ac2c of volume e875c7e6-2911-46ab-aa1f-4a86cec34076 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 19:58:07 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1cd6bd-2bc6-48b7-8b11-2799d6564d3d]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:58:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-94bde6ee-fc1a-4f32-9bfc-1819295539ca tempest-VolumesSnapshotListTestJSON-1034354756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:07 devstack sudo[103569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076 Sep 10 19:58:07 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:07 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-94bde6ee-fc1a-4f32-9bfc-1819295539ca tempest-VolumesSnapshotListTestJSON-1034354756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076" returned: 0 in 0.569s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-94bde6ee-fc1a-4f32-9bfc-1819295539ca tempest-VolumesSnapshotListTestJSON-1034354756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:07 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c 1G Sep 10 19:58:07 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:08 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-94bde6ee-fc1a-4f32-9bfc-1819295539ca tempest-VolumesSnapshotListTestJSON-1034354756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c 1G" returned: 0 in 0.626s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-94bde6ee-fc1a-4f32-9bfc-1819295539ca tempest-VolumesSnapshotListTestJSON-1034354756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e875c7e6-2911-46ab-aa1f-4a86cec34076 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:08 devstack sudo[103590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e875c7e6-2911-46ab-aa1f-4a86cec34076 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c Sep 10 19:58:08 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-a5ae8e2f-5e97-4a98-932e-8a3200a76563 req-2e8eaf16-ebea-4b5a-a458-b9344732152d tempest-TestServerVolumeAttachmentScenario-29456212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:58:08 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-94bde6ee-fc1a-4f32-9bfc-1819295539ca tempest-VolumesSnapshotListTestJSON-1034354756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e875c7e6-2911-46ab-aa1f-4a86cec34076 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c" returned: 0 in 0.357s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:08 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-94bde6ee-fc1a-4f32-9bfc-1819295539ca tempest-VolumesSnapshotListTestJSON-1034354756 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c is being set with open permissions: ugo+rw Sep 10 19:58:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-94bde6ee-fc1a-4f32-9bfc-1819295539ca tempest-VolumesSnapshotListTestJSON-1034354756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:08 devstack sudo[103596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c Sep 10 19:58:08 devstack sudo[103596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:08 devstack sudo[103596]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-94bde6ee-fc1a-4f32-9bfc-1819295539ca tempest-VolumesSnapshotListTestJSON-1034354756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c" returned: 0 in 0.267s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-94bde6ee-fc1a-4f32-9bfc-1819295539ca tempest-VolumesSnapshotListTestJSON-1034354756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:09 devstack sudo[103600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.info Sep 10 19:58:09 devstack sudo[103600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:09 devstack sudo[103600]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-94bde6ee-fc1a-4f32-9bfc-1819295539ca tempest-VolumesSnapshotListTestJSON-1034354756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.info" returned: 0 in 0.369s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:09 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-94bde6ee-fc1a-4f32-9bfc-1819295539ca tempest-VolumesSnapshotListTestJSON-1034354756 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.info is being set with open permissions: ugo+rw Sep 10 19:58:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-94bde6ee-fc1a-4f32-9bfc-1819295539ca tempest-VolumesSnapshotListTestJSON-1034354756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:09 devstack sudo[103603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.info Sep 10 19:58:09 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:09 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-94bde6ee-fc1a-4f32-9bfc-1819295539ca tempest-VolumesSnapshotListTestJSON-1034354756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.info" returned: 0 in 0.292s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-94bde6ee-fc1a-4f32-9bfc-1819295539ca tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.628s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:58:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-a5ae8e2f-5e97-4a98-932e-8a3200a76563 req-2e8eaf16-ebea-4b5a-a458-b9344732152d tempest-TestServerVolumeAttachmentScenario-29456212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.152s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:58:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-a5ae8e2f-5e97-4a98-932e-8a3200a76563 req-2e8eaf16-ebea-4b5a-a458-b9344732152d tempest-TestServerVolumeAttachmentScenario-29456212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:58:09 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-94bde6ee-fc1a-4f32-9bfc-1819295539ca tempest-VolumesSnapshotListTestJSON-1034354756 None] Create snapshot completed successfully Sep 10 19:58:09 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-a5ae8e2f-5e97-4a98-932e-8a3200a76563 req-2e8eaf16-ebea-4b5a-a458-b9344732152d tempest-TestServerVolumeAttachmentScenario-29456212 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3', 'name': 'volume-43257de5-bd6a-4b4e-9fba-d79a5c8f790e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4aa6f299-c08f-4d39-8308-5de9fa13c782', 'enforce_multipath': True} {{(pid=88093) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 19:58:09 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-a5ae8e2f-5e97-4a98-932e-8a3200a76563 req-2e8eaf16-ebea-4b5a-a458-b9344732152d tempest-TestServerVolumeAttachmentScenario-29456212 None] attachment_update completed successfully. Sep 10 19:58:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0143616a-1bbd-4352-93f3-ebc7d9819aa7 tempest-VolumesSnapshotListTestJSON-1034354756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:58:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0143616a-1bbd-4352-93f3-ebc7d9819aa7 tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:58:10 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-0143616a-1bbd-4352-93f3-ebc7d9819aa7 tempest-VolumesSnapshotListTestJSON-1034354756 None] Creating offline snapshot d4c769a3-00c4-49f9-a827-99e6a53a6070 of volume e875c7e6-2911-46ab-aa1f-4a86cec34076 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 19:58:10 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d67ecc-afac-4808-9eac-5a46d58ccd6c]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:58:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0143616a-1bbd-4352-93f3-ebc7d9819aa7 tempest-VolumesSnapshotListTestJSON-1034354756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:10 devstack sudo[103609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c Sep 10 19:58:10 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:11 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0143616a-1bbd-4352-93f3-ebc7d9819aa7 tempest-VolumesSnapshotListTestJSON-1034354756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c" returned: 0 in 0.457s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-0143616a-1bbd-4352-93f3-ebc7d9819aa7 tempest-VolumesSnapshotListTestJSON-1034354756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e875c7e6-2911-46ab-aa1f-4a86cec34076(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:58:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0143616a-1bbd-4352-93f3-ebc7d9819aa7 tempest-VolumesSnapshotListTestJSON-1034354756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:11 devstack sudo[103615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070 1G Sep 10 19:58:11 devstack sudo[103615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:11 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-cecf2fc0-f7d8-4a5c-8b48-55a9cfc4cfad req-0ba42ec2-0323-40a6-bf02-d4aed163f2ed tempest-TestServerVolumeAttachmentScenario-29456212 None] Terminate volume connection completed successfully. Sep 10 19:58:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-cecf2fc0-f7d8-4a5c-8b48-55a9cfc4cfad req-0ba42ec2-0323-40a6-bf02-d4aed163f2ed tempest-TestServerVolumeAttachmentScenario-29456212 None] Deleting attachment 4aa6f299-c08f-4d39-8308-5de9fa13c782. {{(pid=88093) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 19:58:11 devstack sudo[103615]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0143616a-1bbd-4352-93f3-ebc7d9819aa7 tempest-VolumesSnapshotListTestJSON-1034354756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070 1G" returned: 0 in 0.495s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0143616a-1bbd-4352-93f3-ebc7d9819aa7 tempest-VolumesSnapshotListTestJSON-1034354756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:11 devstack sudo[103623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070 Sep 10 19:58:11 devstack sudo[103623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:11 devstack sudo[103623]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0143616a-1bbd-4352-93f3-ebc7d9819aa7 tempest-VolumesSnapshotListTestJSON-1034354756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070" returned: 0 in 0.279s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:11 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-0143616a-1bbd-4352-93f3-ebc7d9819aa7 tempest-VolumesSnapshotListTestJSON-1034354756 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070 is being set with open permissions: ugo+rw Sep 10 19:58:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0143616a-1bbd-4352-93f3-ebc7d9819aa7 tempest-VolumesSnapshotListTestJSON-1034354756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:11 devstack sudo[103628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070 Sep 10 19:58:11 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:12 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0143616a-1bbd-4352-93f3-ebc7d9819aa7 tempest-VolumesSnapshotListTestJSON-1034354756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070" returned: 0 in 0.274s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0143616a-1bbd-4352-93f3-ebc7d9819aa7 tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.643s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:58:12 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-0143616a-1bbd-4352-93f3-ebc7d9819aa7 tempest-VolumesSnapshotListTestJSON-1034354756 None] Create snapshot completed successfully Sep 10 19:58:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-57d894b1-e20c-43c7-a5bb-4998f02b6458 tempest-VolumesSnapshotListTestJSON-1034354756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:58:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-57d894b1-e20c-43c7-a5bb-4998f02b6458 tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:58:12 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-57d894b1-e20c-43c7-a5bb-4998f02b6458 tempest-VolumesSnapshotListTestJSON-1034354756 None] Creating offline snapshot d569b05d-e943-42b0-b3e6-e2a7375ad2d1 of volume e875c7e6-2911-46ab-aa1f-4a86cec34076 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 19:58:12 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[a633e0e2-4907-432a-b538-2d30b0cedba3]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:58:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-57d894b1-e20c-43c7-a5bb-4998f02b6458 tempest-VolumesSnapshotListTestJSON-1034354756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:12 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-4a03a298-58a0-4af3-a86e-950f1d3035d8 req-84d90a93-7769-4ca1-bbbd-25e7090b46a5 tempest-TestServerVolumeAttachmentScenario-29456212 None] Terminate volume connection completed successfully. Sep 10 19:58:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-4a03a298-58a0-4af3-a86e-950f1d3035d8 req-84d90a93-7769-4ca1-bbbd-25e7090b46a5 tempest-TestServerVolumeAttachmentScenario-29456212 None] Deleting attachment 4f8953ab-a4e8-42a3-b2c8-7c0436f0a7c4. {{(pid=88093) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 19:58:12 devstack sudo[103633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070 Sep 10 19:58:12 devstack sudo[103633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:13 devstack sudo[103633]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-57d894b1-e20c-43c7-a5bb-4998f02b6458 tempest-VolumesSnapshotListTestJSON-1034354756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070" returned: 0 in 0.412s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:13 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-57d894b1-e20c-43c7-a5bb-4998f02b6458 tempest-VolumesSnapshotListTestJSON-1034354756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e875c7e6-2911-46ab-aa1f-4a86cec34076(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:58:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-57d894b1-e20c-43c7-a5bb-4998f02b6458 tempest-VolumesSnapshotListTestJSON-1034354756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d569b05d-e943-42b0-b3e6-e2a7375ad2d1 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:13 devstack sudo[103638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d569b05d-e943-42b0-b3e6-e2a7375ad2d1 1G Sep 10 19:58:13 devstack sudo[103638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:13 devstack sudo[103638]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-57d894b1-e20c-43c7-a5bb-4998f02b6458 tempest-VolumesSnapshotListTestJSON-1034354756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d569b05d-e943-42b0-b3e6-e2a7375ad2d1 1G" returned: 0 in 0.565s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-57d894b1-e20c-43c7-a5bb-4998f02b6458 tempest-VolumesSnapshotListTestJSON-1034354756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d569b05d-e943-42b0-b3e6-e2a7375ad2d1 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:13 devstack sudo[103644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d569b05d-e943-42b0-b3e6-e2a7375ad2d1 Sep 10 19:58:13 devstack sudo[103644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:14 devstack sudo[103644]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-57d894b1-e20c-43c7-a5bb-4998f02b6458 tempest-VolumesSnapshotListTestJSON-1034354756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d569b05d-e943-42b0-b3e6-e2a7375ad2d1" returned: 0 in 0.369s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:14 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-57d894b1-e20c-43c7-a5bb-4998f02b6458 tempest-VolumesSnapshotListTestJSON-1034354756 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d569b05d-e943-42b0-b3e6-e2a7375ad2d1 is being set with open permissions: ugo+rw Sep 10 19:58:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-57d894b1-e20c-43c7-a5bb-4998f02b6458 tempest-VolumesSnapshotListTestJSON-1034354756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d569b05d-e943-42b0-b3e6-e2a7375ad2d1 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:14 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d569b05d-e943-42b0-b3e6-e2a7375ad2d1 Sep 10 19:58:14 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:14 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-57d894b1-e20c-43c7-a5bb-4998f02b6458 tempest-VolumesSnapshotListTestJSON-1034354756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d569b05d-e943-42b0-b3e6-e2a7375ad2d1" returned: 0 in 0.432s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-57d894b1-e20c-43c7-a5bb-4998f02b6458 tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.908s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:58:14 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-57d894b1-e20c-43c7-a5bb-4998f02b6458 tempest-VolumesSnapshotListTestJSON-1034354756 None] Create snapshot completed successfully Sep 10 19:58:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-898f2c90-1769-4df7-a6a9-99bc1aeb631c tempest-VolumesSnapshotListTestJSON-1034354756 None] Acquiring lock "cinder-d569b05d-e943-42b0-b3e6-e2a7375ad2d1-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:58:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-898f2c90-1769-4df7-a6a9-99bc1aeb631c tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "cinder-d569b05d-e943-42b0-b3e6-e2a7375ad2d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:58:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-898f2c90-1769-4df7-a6a9-99bc1aeb631c tempest-VolumesSnapshotListTestJSON-1034354756 None] Acquiring lock "cinder-quobyte-e875c7e6-2911-46ab-aa1f-4a86cec34076" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:58:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-898f2c90-1769-4df7-a6a9-99bc1aeb631c tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "cinder-quobyte-e875c7e6-2911-46ab-aa1f-4a86cec34076" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:58:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-898f2c90-1769-4df7-a6a9-99bc1aeb631c tempest-VolumesSnapshotListTestJSON-1034354756 None] Acquiring lock "cinder-quobyte-d569b05d-e943-42b0-b3e6-e2a7375ad2d1" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:58:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-898f2c90-1769-4df7-a6a9-99bc1aeb631c tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "cinder-quobyte-d569b05d-e943-42b0-b3e6-e2a7375ad2d1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:58:16 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-898f2c90-1769-4df7-a6a9-99bc1aeb631c tempest-VolumesSnapshotListTestJSON-1034354756 None] Deleting offline snapshot d569b05d-e943-42b0-b3e6-e2a7375ad2d1 of volume e875c7e6-2911-46ab-aa1f-4a86cec34076 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 19:58:16 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-898f2c90-1769-4df7-a6a9-99bc1aeb631c tempest-VolumesSnapshotListTestJSON-1034354756 None] snapshot_file for this snap is: volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d569b05d-e943-42b0-b3e6-e2a7375ad2d1 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 19:58:16 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ae652a-178c-40a7-9346-a40590944e79]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:58:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-898f2c90-1769-4df7-a6a9-99bc1aeb631c tempest-VolumesSnapshotListTestJSON-1034354756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d569b05d-e943-42b0-b3e6-e2a7375ad2d1 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:16 devstack sudo[103679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d569b05d-e943-42b0-b3e6-e2a7375ad2d1 Sep 10 19:58:16 devstack sudo[103679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:16 devstack sudo[103679]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-898f2c90-1769-4df7-a6a9-99bc1aeb631c tempest-VolumesSnapshotListTestJSON-1034354756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d569b05d-e943-42b0-b3e6-e2a7375ad2d1" returned: 0 in 0.464s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:16 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-898f2c90-1769-4df7-a6a9-99bc1aeb631c tempest-VolumesSnapshotListTestJSON-1034354756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e875c7e6-2911-46ab-aa1f-4a86cec34076(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:58:16 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b274888-05fb-4a01-8ace-d70a9e0eb4fa]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:58:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-898f2c90-1769-4df7-a6a9-99bc1aeb631c tempest-VolumesSnapshotListTestJSON-1034354756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:16 devstack sudo[103684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070 Sep 10 19:58:16 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:17 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-898f2c90-1769-4df7-a6a9-99bc1aeb631c tempest-VolumesSnapshotListTestJSON-1034354756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070" returned: 0 in 0.459s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:17 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-898f2c90-1769-4df7-a6a9-99bc1aeb631c tempest-VolumesSnapshotListTestJSON-1034354756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e875c7e6-2911-46ab-aa1f-4a86cec34076(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:58:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-898f2c90-1769-4df7-a6a9-99bc1aeb631c tempest-VolumesSnapshotListTestJSON-1034354756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d569b05d-e943-42b0-b3e6-e2a7375ad2d1 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:17 devstack sudo[103713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d569b05d-e943-42b0-b3e6-e2a7375ad2d1 Sep 10 19:58:17 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:17 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-898f2c90-1769-4df7-a6a9-99bc1aeb631c tempest-VolumesSnapshotListTestJSON-1034354756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d569b05d-e943-42b0-b3e6-e2a7375ad2d1" returned: 0 in 0.449s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-898f2c90-1769-4df7-a6a9-99bc1aeb631c tempest-VolumesSnapshotListTestJSON-1034354756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d569b05d-e943-42b0-b3e6-e2a7375ad2d1 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:17 devstack sudo[103731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d569b05d-e943-42b0-b3e6-e2a7375ad2d1 Sep 10 19:58:17 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:17 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-898f2c90-1769-4df7-a6a9-99bc1aeb631c tempest-VolumesSnapshotListTestJSON-1034354756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d569b05d-e943-42b0-b3e6-e2a7375ad2d1" returned: 0 in 0.275s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:18 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-898f2c90-1769-4df7-a6a9-99bc1aeb631c tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "cinder-quobyte-d569b05d-e943-42b0-b3e6-e2a7375ad2d1" released by "_delete_snapshot" :: held 1.838s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:58:18 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-898f2c90-1769-4df7-a6a9-99bc1aeb631c tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "cinder-quobyte-e875c7e6-2911-46ab-aa1f-4a86cec34076" released by "delete_snapshot" :: held 1.869s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:58:18 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-898f2c90-1769-4df7-a6a9-99bc1aeb631c tempest-VolumesSnapshotListTestJSON-1034354756 None] Created reservations ['a0dc08ec-5b21-43b9-a817-ea3e98f2988f', 'd897fdd9-e1ee-4a74-be5b-e9f87dc94a57', 'e427b12f-3801-41b0-ba1d-00407c32febf', 'f4d41424-06a3-473e-92cd-195a31232f0f'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:58:18 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-898f2c90-1769-4df7-a6a9-99bc1aeb631c tempest-VolumesSnapshotListTestJSON-1034354756 None] Delete snapshot completed successfully. Sep 10 19:58:18 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-898f2c90-1769-4df7-a6a9-99bc1aeb631c tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "cinder-d569b05d-e943-42b0-b3e6-e2a7375ad2d1-delete_snapshot" released by "delete_snapshot" :: held 2.054s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:58:18 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-16fd314a-44cf-4932-a17e-1cc9f1ee6b82 tempest-VolumesSnapshotListTestJSON-1034354756 None] Acquiring lock "cinder-d4c769a3-00c4-49f9-a827-99e6a53a6070-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:58:18 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-16fd314a-44cf-4932-a17e-1cc9f1ee6b82 tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "cinder-d4c769a3-00c4-49f9-a827-99e6a53a6070-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:58:18 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-16fd314a-44cf-4932-a17e-1cc9f1ee6b82 tempest-VolumesSnapshotListTestJSON-1034354756 None] Acquiring lock "cinder-quobyte-e875c7e6-2911-46ab-aa1f-4a86cec34076" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:58:18 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-16fd314a-44cf-4932-a17e-1cc9f1ee6b82 tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "cinder-quobyte-e875c7e6-2911-46ab-aa1f-4a86cec34076" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:58:18 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-16fd314a-44cf-4932-a17e-1cc9f1ee6b82 tempest-VolumesSnapshotListTestJSON-1034354756 None] Acquiring lock "cinder-quobyte-d4c769a3-00c4-49f9-a827-99e6a53a6070" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:58:18 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-16fd314a-44cf-4932-a17e-1cc9f1ee6b82 tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "cinder-quobyte-d4c769a3-00c4-49f9-a827-99e6a53a6070" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:58:18 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-16fd314a-44cf-4932-a17e-1cc9f1ee6b82 tempest-VolumesSnapshotListTestJSON-1034354756 None] Deleting offline snapshot d4c769a3-00c4-49f9-a827-99e6a53a6070 of volume e875c7e6-2911-46ab-aa1f-4a86cec34076 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 19:58:18 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-16fd314a-44cf-4932-a17e-1cc9f1ee6b82 tempest-VolumesSnapshotListTestJSON-1034354756 None] snapshot_file for this snap is: volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 19:58:18 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f4ba1d-3234-4006-80ae-23f8806fc086]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:58:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-16fd314a-44cf-4932-a17e-1cc9f1ee6b82 tempest-VolumesSnapshotListTestJSON-1034354756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:18 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070 Sep 10 19:58:18 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:18 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-16fd314a-44cf-4932-a17e-1cc9f1ee6b82 tempest-VolumesSnapshotListTestJSON-1034354756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070" returned: 0 in 0.367s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:18 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-16fd314a-44cf-4932-a17e-1cc9f1ee6b82 tempest-VolumesSnapshotListTestJSON-1034354756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e875c7e6-2911-46ab-aa1f-4a86cec34076(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:58:18 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34617d4-5646-43e2-98d1-9421170664f5]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:58:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-16fd314a-44cf-4932-a17e-1cc9f1ee6b82 tempest-VolumesSnapshotListTestJSON-1034354756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:18 devstack sudo[103740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c Sep 10 19:58:18 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:19 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7988b05c-6b14-44a4-b846-ea5e8738260b tempest-TestServerVolumeAttachmentScenario-29456212 None] Acquiring lock "cinder-43257de5-bd6a-4b4e-9fba-d79a5c8f790e-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:58:19 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7988b05c-6b14-44a4-b846-ea5e8738260b tempest-TestServerVolumeAttachmentScenario-29456212 None] Lock "cinder-43257de5-bd6a-4b4e-9fba-d79a5c8f790e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:58:19 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7988b05c-6b14-44a4-b846-ea5e8738260b tempest-TestServerVolumeAttachmentScenario-29456212 None] Acquiring lock "cinder-quobyte-43257de5-bd6a-4b4e-9fba-d79a5c8f790e" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:58:19 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7988b05c-6b14-44a4-b846-ea5e8738260b tempest-TestServerVolumeAttachmentScenario-29456212 None] Lock "cinder-quobyte-43257de5-bd6a-4b4e-9fba-d79a5c8f790e" acquired by "delete_volume" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:58:19 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85c5fb9-8ed6-4029-9b34-da2c717ab958]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:58:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7988b05c-6b14-44a4-b846-ea5e8738260b tempest-TestServerVolumeAttachmentScenario-29456212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-43257de5-bd6a-4b4e-9fba-d79a5c8f790e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:19 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-16fd314a-44cf-4932-a17e-1cc9f1ee6b82 tempest-VolumesSnapshotListTestJSON-1034354756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c" returned: 0 in 0.402s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:19 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-16fd314a-44cf-4932-a17e-1cc9f1ee6b82 tempest-VolumesSnapshotListTestJSON-1034354756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e875c7e6-2911-46ab-aa1f-4a86cec34076(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:58:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-16fd314a-44cf-4932-a17e-1cc9f1ee6b82 tempest-VolumesSnapshotListTestJSON-1034354756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:19 devstack sudo[103746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070 Sep 10 19:58:19 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:19 devstack sudo[103745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-43257de5-bd6a-4b4e-9fba-d79a5c8f790e Sep 10 19:58:19 devstack sudo[103745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:19 devstack sudo[103745]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7988b05c-6b14-44a4-b846-ea5e8738260b tempest-TestServerVolumeAttachmentScenario-29456212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-43257de5-bd6a-4b4e-9fba-d79a5c8f790e" returned: 0 in 0.402s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7988b05c-6b14-44a4-b846-ea5e8738260b tempest-TestServerVolumeAttachmentScenario-29456212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-43257de5-bd6a-4b4e-9fba-d79a5c8f790e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:19 devstack sudo[103755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-43257de5-bd6a-4b4e-9fba-d79a5c8f790e Sep 10 19:58:19 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:19 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-16fd314a-44cf-4932-a17e-1cc9f1ee6b82 tempest-VolumesSnapshotListTestJSON-1034354756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070" returned: 0 in 0.404s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-16fd314a-44cf-4932-a17e-1cc9f1ee6b82 tempest-VolumesSnapshotListTestJSON-1034354756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:19 devstack sudo[103757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070 Sep 10 19:58:19 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:19 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7988b05c-6b14-44a4-b846-ea5e8738260b tempest-TestServerVolumeAttachmentScenario-29456212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-43257de5-bd6a-4b4e-9fba-d79a5c8f790e" returned: 0 in 0.260s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:19 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7988b05c-6b14-44a4-b846-ea5e8738260b tempest-TestServerVolumeAttachmentScenario-29456212 None] Lock "cinder-quobyte-43257de5-bd6a-4b4e-9fba-d79a5c8f790e" released by "delete_volume" :: held 0.711s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:58:19 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-16fd314a-44cf-4932-a17e-1cc9f1ee6b82 tempest-VolumesSnapshotListTestJSON-1034354756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.d4c769a3-00c4-49f9-a827-99e6a53a6070" returned: 0 in 0.251s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:19 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-16fd314a-44cf-4932-a17e-1cc9f1ee6b82 tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "cinder-quobyte-d4c769a3-00c4-49f9-a827-99e6a53a6070" released by "_delete_snapshot" :: held 1.545s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:58:19 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-16fd314a-44cf-4932-a17e-1cc9f1ee6b82 tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "cinder-quobyte-e875c7e6-2911-46ab-aa1f-4a86cec34076" released by "delete_snapshot" :: held 1.583s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:58:19 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-7988b05c-6b14-44a4-b846-ea5e8738260b tempest-TestServerVolumeAttachmentScenario-29456212 None] Created reservations ['fea01e69-f2e7-4be7-ab12-35a2e69a280e', '00bb4ab8-c501-4393-971f-24f25cb7e89a', '6054f33b-1916-47ac-ab61-73b64ed643dc', '7a81f2a0-7f6b-4bf9-be10-bf418c560d7e'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:58:20 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-16fd314a-44cf-4932-a17e-1cc9f1ee6b82 tempest-VolumesSnapshotListTestJSON-1034354756 None] Created reservations ['665074e4-dac6-4b24-aca3-69e891e75ec2', 'ec636df4-fd9e-49d4-8471-8334e8dddd2b', '56713186-7113-4325-b400-c5dd53631623', '5d793b4d-67b9-46d6-aa06-3ffc623461b6'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:58:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7988b05c-6b14-44a4-b846-ea5e8738260b tempest-TestServerVolumeAttachmentScenario-29456212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:58:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7988b05c-6b14-44a4-b846-ea5e8738260b tempest-TestServerVolumeAttachmentScenario-29456212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:58:20 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7988b05c-6b14-44a4-b846-ea5e8738260b tempest-TestServerVolumeAttachmentScenario-29456212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:58:20 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7988b05c-6b14-44a4-b846-ea5e8738260b tempest-TestServerVolumeAttachmentScenario-29456212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:58:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7988b05c-6b14-44a4-b846-ea5e8738260b tempest-TestServerVolumeAttachmentScenario-29456212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:58:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7988b05c-6b14-44a4-b846-ea5e8738260b tempest-TestServerVolumeAttachmentScenario-29456212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:20 devstack sudo[103762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:58:20 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:20 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-16fd314a-44cf-4932-a17e-1cc9f1ee6b82 tempest-VolumesSnapshotListTestJSON-1034354756 None] Delete snapshot completed successfully. Sep 10 19:58:20 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-16fd314a-44cf-4932-a17e-1cc9f1ee6b82 tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "cinder-d4c769a3-00c4-49f9-a827-99e6a53a6070-delete_snapshot" released by "delete_snapshot" :: held 1.817s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:58:20 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-fb4be65d-4ce7-4c18-97b7-17e469103c50 tempest-TestServerVolumeAttachmentScenario-29456212 None] Acquiring lock "cinder-153c7dfc-f6ae-45e5-a128-52cf6f3e1742-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:58:20 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-fb4be65d-4ce7-4c18-97b7-17e469103c50 tempest-TestServerVolumeAttachmentScenario-29456212 None] Lock "cinder-153c7dfc-f6ae-45e5-a128-52cf6f3e1742-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:58:20 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:20 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-fb4be65d-4ce7-4c18-97b7-17e469103c50 tempest-TestServerVolumeAttachmentScenario-29456212 None] Acquiring lock "cinder-quobyte-153c7dfc-f6ae-45e5-a128-52cf6f3e1742" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:58:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7988b05c-6b14-44a4-b846-ea5e8738260b tempest-TestServerVolumeAttachmentScenario-29456212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.290s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:20 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-7988b05c-6b14-44a4-b846-ea5e8738260b tempest-TestServerVolumeAttachmentScenario-29456212 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:58:20 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-7988b05c-6b14-44a4-b846-ea5e8738260b tempest-TestServerVolumeAttachmentScenario-29456212 None] Deleted volume successfully. Sep 10 19:58:20 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-fb4be65d-4ce7-4c18-97b7-17e469103c50 tempest-TestServerVolumeAttachmentScenario-29456212 None] Lock "cinder-quobyte-153c7dfc-f6ae-45e5-a128-52cf6f3e1742" acquired by "delete_volume" :: waited 0.047s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:58:20 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7988b05c-6b14-44a4-b846-ea5e8738260b tempest-TestServerVolumeAttachmentScenario-29456212 None] Lock "cinder-43257de5-bd6a-4b4e-9fba-d79a5c8f790e-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:58:20 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[01288adf-17bf-4caf-ae3f-a355a2fdf3dd]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:58:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fb4be65d-4ce7-4c18-97b7-17e469103c50 tempest-TestServerVolumeAttachmentScenario-29456212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-153c7dfc-f6ae-45e5-a128-52cf6f3e1742 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:20 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-910ac035-d5e2-4cf9-bb45-8a6c32192290 tempest-VolumesSnapshotListTestJSON-1034354756 None] Acquiring lock "cinder-f44a68c8-2a25-4231-986a-9b7c5fd9ac2c-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:58:20 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-910ac035-d5e2-4cf9-bb45-8a6c32192290 tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "cinder-f44a68c8-2a25-4231-986a-9b7c5fd9ac2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:58:20 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-910ac035-d5e2-4cf9-bb45-8a6c32192290 tempest-VolumesSnapshotListTestJSON-1034354756 None] Acquiring lock "cinder-quobyte-e875c7e6-2911-46ab-aa1f-4a86cec34076" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:58:20 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-910ac035-d5e2-4cf9-bb45-8a6c32192290 tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "cinder-quobyte-e875c7e6-2911-46ab-aa1f-4a86cec34076" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:58:20 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-910ac035-d5e2-4cf9-bb45-8a6c32192290 tempest-VolumesSnapshotListTestJSON-1034354756 None] Acquiring lock "cinder-quobyte-f44a68c8-2a25-4231-986a-9b7c5fd9ac2c" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:58:20 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-910ac035-d5e2-4cf9-bb45-8a6c32192290 tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "cinder-quobyte-f44a68c8-2a25-4231-986a-9b7c5fd9ac2c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:58:20 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-153c7dfc-f6ae-45e5-a128-52cf6f3e1742 Sep 10 19:58:20 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:20 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-910ac035-d5e2-4cf9-bb45-8a6c32192290 tempest-VolumesSnapshotListTestJSON-1034354756 None] Deleting offline snapshot f44a68c8-2a25-4231-986a-9b7c5fd9ac2c of volume e875c7e6-2911-46ab-aa1f-4a86cec34076 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 19:58:20 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-910ac035-d5e2-4cf9-bb45-8a6c32192290 tempest-VolumesSnapshotListTestJSON-1034354756 None] snapshot_file for this snap is: volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 19:58:20 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[3214df8b-bb1f-4a21-bb0d-0ebd073d34e6]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:58:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-910ac035-d5e2-4cf9-bb45-8a6c32192290 tempest-VolumesSnapshotListTestJSON-1034354756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:20 devstack sudo[103767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c Sep 10 19:58:20 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:20 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fb4be65d-4ce7-4c18-97b7-17e469103c50 tempest-TestServerVolumeAttachmentScenario-29456212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-153c7dfc-f6ae-45e5-a128-52cf6f3e1742" returned: 0 in 0.406s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fb4be65d-4ce7-4c18-97b7-17e469103c50 tempest-TestServerVolumeAttachmentScenario-29456212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-153c7dfc-f6ae-45e5-a128-52cf6f3e1742 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:20 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-153c7dfc-f6ae-45e5-a128-52cf6f3e1742 Sep 10 19:58:20 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:21 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-910ac035-d5e2-4cf9-bb45-8a6c32192290 tempest-VolumesSnapshotListTestJSON-1034354756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c" returned: 0 in 0.368s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:21 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-910ac035-d5e2-4cf9-bb45-8a6c32192290 tempest-VolumesSnapshotListTestJSON-1034354756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e875c7e6-2911-46ab-aa1f-4a86cec34076(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 19:58:21 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1f29f6-f5c2-482f-8140-9e64f597da85]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:58:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-910ac035-d5e2-4cf9-bb45-8a6c32192290 tempest-VolumesSnapshotListTestJSON-1034354756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:21 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fb4be65d-4ce7-4c18-97b7-17e469103c50 tempest-TestServerVolumeAttachmentScenario-29456212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-153c7dfc-f6ae-45e5-a128-52cf6f3e1742" returned: 0 in 0.303s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:21 devstack sudo[103779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076 Sep 10 19:58:21 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:21 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-fb4be65d-4ce7-4c18-97b7-17e469103c50 tempest-TestServerVolumeAttachmentScenario-29456212 None] Lock "cinder-quobyte-153c7dfc-f6ae-45e5-a128-52cf6f3e1742" released by "delete_volume" :: held 0.775s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:58:21 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-fb4be65d-4ce7-4c18-97b7-17e469103c50 tempest-TestServerVolumeAttachmentScenario-29456212 None] Created reservations ['9c5c30ad-7f19-4e14-8230-6b19d170bb48', '03466233-f357-4457-b994-d7d0f56c651e', '7b0120b4-a32c-4afa-8b08-f87d9effe65f', '72cbf97c-dc18-49c9-8d44-6e706fdba44a'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:58:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-fb4be65d-4ce7-4c18-97b7-17e469103c50 tempest-TestServerVolumeAttachmentScenario-29456212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:58:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-fb4be65d-4ce7-4c18-97b7-17e469103c50 tempest-TestServerVolumeAttachmentScenario-29456212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:58:21 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-fb4be65d-4ce7-4c18-97b7-17e469103c50 tempest-TestServerVolumeAttachmentScenario-29456212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:58:21 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-fb4be65d-4ce7-4c18-97b7-17e469103c50 tempest-TestServerVolumeAttachmentScenario-29456212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:58:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-fb4be65d-4ce7-4c18-97b7-17e469103c50 tempest-TestServerVolumeAttachmentScenario-29456212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:58:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fb4be65d-4ce7-4c18-97b7-17e469103c50 tempest-TestServerVolumeAttachmentScenario-29456212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:21 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:58:21 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:21 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-910ac035-d5e2-4cf9-bb45-8a6c32192290 tempest-VolumesSnapshotListTestJSON-1034354756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076" returned: 0 in 0.432s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-910ac035-d5e2-4cf9-bb45-8a6c32192290 tempest-VolumesSnapshotListTestJSON-1034354756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:21 devstack sudo[103787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c Sep 10 19:58:21 devstack sudo[103787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:21 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fb4be65d-4ce7-4c18-97b7-17e469103c50 tempest-TestServerVolumeAttachmentScenario-29456212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.278s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:21 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-fb4be65d-4ce7-4c18-97b7-17e469103c50 tempest-TestServerVolumeAttachmentScenario-29456212 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:58:21 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-fb4be65d-4ce7-4c18-97b7-17e469103c50 tempest-TestServerVolumeAttachmentScenario-29456212 None] Deleted volume successfully. Sep 10 19:58:21 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-fb4be65d-4ce7-4c18-97b7-17e469103c50 tempest-TestServerVolumeAttachmentScenario-29456212 None] Lock "cinder-153c7dfc-f6ae-45e5-a128-52cf6f3e1742-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:58:21 devstack sudo[103787]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-910ac035-d5e2-4cf9-bb45-8a6c32192290 tempest-VolumesSnapshotListTestJSON-1034354756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c" returned: 0 in 0.394s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-910ac035-d5e2-4cf9-bb45-8a6c32192290 tempest-VolumesSnapshotListTestJSON-1034354756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:21 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c Sep 10 19:58:21 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:22 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-910ac035-d5e2-4cf9-bb45-8a6c32192290 tempest-VolumesSnapshotListTestJSON-1034354756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076.f44a68c8-2a25-4231-986a-9b7c5fd9ac2c" returned: 0 in 0.270s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:22 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-910ac035-d5e2-4cf9-bb45-8a6c32192290 tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "cinder-quobyte-f44a68c8-2a25-4231-986a-9b7c5fd9ac2c" released by "_delete_snapshot" :: held 1.579s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:58:22 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-910ac035-d5e2-4cf9-bb45-8a6c32192290 tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "cinder-quobyte-e875c7e6-2911-46ab-aa1f-4a86cec34076" released by "delete_snapshot" :: held 1.611s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:58:22 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-910ac035-d5e2-4cf9-bb45-8a6c32192290 tempest-VolumesSnapshotListTestJSON-1034354756 None] Created reservations ['02058858-8b42-47a7-91f1-62435d21a3da', 'dc629827-288f-4026-83e4-a02077e7a7c5', 'af448c3d-1313-4719-ab5d-445f0559529e', 'a6f7ae67-eb73-4253-b347-341dc2c91d08'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:58:22 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-910ac035-d5e2-4cf9-bb45-8a6c32192290 tempest-VolumesSnapshotListTestJSON-1034354756 None] Delete snapshot completed successfully. Sep 10 19:58:22 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-910ac035-d5e2-4cf9-bb45-8a6c32192290 tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "cinder-f44a68c8-2a25-4231-986a-9b7c5fd9ac2c-delete_snapshot" released by "delete_snapshot" :: held 1.797s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:58:22 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bc4148e1-c28e-4f49-883e-b3a29f6fddf6 tempest-VolumesSnapshotListTestJSON-1034354756 None] Acquiring lock "cinder-e875c7e6-2911-46ab-aa1f-4a86cec34076-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:58:22 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bc4148e1-c28e-4f49-883e-b3a29f6fddf6 tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "cinder-e875c7e6-2911-46ab-aa1f-4a86cec34076-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:58:22 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bc4148e1-c28e-4f49-883e-b3a29f6fddf6 tempest-VolumesSnapshotListTestJSON-1034354756 None] Acquiring lock "cinder-quobyte-e875c7e6-2911-46ab-aa1f-4a86cec34076" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:58:22 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bc4148e1-c28e-4f49-883e-b3a29f6fddf6 tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "cinder-quobyte-e875c7e6-2911-46ab-aa1f-4a86cec34076" acquired by "delete_volume" :: waited 0.016s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:58:22 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4418cf-78d2-432a-a666-43a66374e738]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:58:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bc4148e1-c28e-4f49-883e-b3a29f6fddf6 tempest-VolumesSnapshotListTestJSON-1034354756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:23 devstack sudo[103797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076 Sep 10 19:58:23 devstack sudo[103797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:23 devstack sudo[103797]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bc4148e1-c28e-4f49-883e-b3a29f6fddf6 tempest-VolumesSnapshotListTestJSON-1034354756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076" returned: 0 in 0.418s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bc4148e1-c28e-4f49-883e-b3a29f6fddf6 tempest-VolumesSnapshotListTestJSON-1034354756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:23 devstack sudo[103802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076 Sep 10 19:58:23 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:23 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bc4148e1-c28e-4f49-883e-b3a29f6fddf6 tempest-VolumesSnapshotListTestJSON-1034354756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e875c7e6-2911-46ab-aa1f-4a86cec34076" returned: 0 in 0.285s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:23 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bc4148e1-c28e-4f49-883e-b3a29f6fddf6 tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "cinder-quobyte-e875c7e6-2911-46ab-aa1f-4a86cec34076" released by "delete_volume" :: held 0.776s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:58:23 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-bc4148e1-c28e-4f49-883e-b3a29f6fddf6 tempest-VolumesSnapshotListTestJSON-1034354756 None] Created reservations ['06324067-c76a-41ba-89c0-ae5bcd1d6bc7', '413b7c52-75b4-4550-94fd-017cc1b8f296', 'c7088ec4-511d-4296-85bb-ccce083a4297', 'fb6f0143-fb21-4373-bad2-8a4fe9ed34e3'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:58:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-bc4148e1-c28e-4f49-883e-b3a29f6fddf6 tempest-VolumesSnapshotListTestJSON-1034354756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:58:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-bc4148e1-c28e-4f49-883e-b3a29f6fddf6 tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:58:23 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-bc4148e1-c28e-4f49-883e-b3a29f6fddf6 tempest-VolumesSnapshotListTestJSON-1034354756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:58:23 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-bc4148e1-c28e-4f49-883e-b3a29f6fddf6 tempest-VolumesSnapshotListTestJSON-1034354756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:58:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-bc4148e1-c28e-4f49-883e-b3a29f6fddf6 tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:58:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bc4148e1-c28e-4f49-883e-b3a29f6fddf6 tempest-VolumesSnapshotListTestJSON-1034354756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:23 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:58:23 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:24 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bc4148e1-c28e-4f49-883e-b3a29f6fddf6 tempest-VolumesSnapshotListTestJSON-1034354756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.350s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:24 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-bc4148e1-c28e-4f49-883e-b3a29f6fddf6 tempest-VolumesSnapshotListTestJSON-1034354756 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:58:24 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-bc4148e1-c28e-4f49-883e-b3a29f6fddf6 tempest-VolumesSnapshotListTestJSON-1034354756 None] Deleted volume successfully. Sep 10 19:58:24 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bc4148e1-c28e-4f49-883e-b3a29f6fddf6 tempest-VolumesSnapshotListTestJSON-1034354756 None] Lock "cinder-e875c7e6-2911-46ab-aa1f-4a86cec34076-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:58:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-77a3449a-737a-418b-a9d3-9edd1bfbf9bc req-c7737f5c-3a3e-4eaf-a030-6b724405c89b tempest-TestInstancesWithCinderVolumes-2036485936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:58:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-77a3449a-737a-418b-a9d3-9edd1bfbf9bc req-c7737f5c-3a3e-4eaf-a030-6b724405c89b tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:58:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-77a3449a-737a-418b-a9d3-9edd1bfbf9bc req-c7737f5c-3a3e-4eaf-a030-6b724405c89b tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:58:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-77a3449a-737a-418b-a9d3-9edd1bfbf9bc req-c7737f5c-3a3e-4eaf-a030-6b724405c89b tempest-TestInstancesWithCinderVolumes-2036485936 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3', 'name': 'volume-5eec03d6-3346-478b-807b-413c1a033c9e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5baae59b-a1bc-4240-96e5-1b19ffc3ba35', 'enforce_multipath': True} {{(pid=88093) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 19:58:30 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-77a3449a-737a-418b-a9d3-9edd1bfbf9bc req-c7737f5c-3a3e-4eaf-a030-6b724405c89b tempest-TestInstancesWithCinderVolumes-2036485936 None] attachment_update completed successfully. Sep 10 19:58:32 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=111,cinder:UPDATE=103,cinder:INSERT=32,cinder:DELETE=8 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:58:32 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:UPDATE=112,cinder:SELECT=106,cinder:DELETE=10,cinder:INSERT=26 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:58:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-4ad3c5c8-2cd2-410a-b2ab-df41a8994195 req-5f93d5f6-5869-478d-8a1e-24ce694c90ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:58:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-4ad3c5c8-2cd2-410a-b2ab-df41a8994195 req-5f93d5f6-5869-478d-8a1e-24ce694c90ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:58:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-4ad3c5c8-2cd2-410a-b2ab-df41a8994195 req-5f93d5f6-5869-478d-8a1e-24ce694c90ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:58:32 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-4ad3c5c8-2cd2-410a-b2ab-df41a8994195 req-5f93d5f6-5869-478d-8a1e-24ce694c90ec tempest-TestInstancesWithCinderVolumes-2036485936 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3', 'name': 'volume-cbdc1d21-39e6-4d6e-b2ec-90c58f69684e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9fcc2c43-4284-4298-923d-b79a96185642', 'enforce_multipath': True} {{(pid=88093) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 19:58:32 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-4ad3c5c8-2cd2-410a-b2ab-df41a8994195 req-5f93d5f6-5869-478d-8a1e-24ce694c90ec tempest-TestInstancesWithCinderVolumes-2036485936 None] attachment_update completed successfully. Sep 10 19:58:38 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-78020a05-7d0c-460f-bfcb-bc0206b7e026 req-972a3fc0-0868-4b8c-9f2f-8c9e4f22e1a8 tempest-TestInstancesWithCinderVolumes-2036485936 None] Terminate volume connection completed successfully. Sep 10 19:58:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-78020a05-7d0c-460f-bfcb-bc0206b7e026 req-972a3fc0-0868-4b8c-9f2f-8c9e4f22e1a8 tempest-TestInstancesWithCinderVolumes-2036485936 None] Deleting attachment 5baae59b-a1bc-4240-96e5-1b19ffc3ba35. {{(pid=88093) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 19:58:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4a333f0e-9042-4129-ba9f-ee02a6a9c902 tempest-TestInstancesWithCinderVolumes-2036485936 None] Acquiring lock "cinder-5eec03d6-3346-478b-807b-413c1a033c9e-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:58:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4a333f0e-9042-4129-ba9f-ee02a6a9c902 tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "cinder-5eec03d6-3346-478b-807b-413c1a033c9e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:58:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4a333f0e-9042-4129-ba9f-ee02a6a9c902 tempest-TestInstancesWithCinderVolumes-2036485936 None] Acquiring lock "cinder-quobyte-5eec03d6-3346-478b-807b-413c1a033c9e" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:58:39 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4a333f0e-9042-4129-ba9f-ee02a6a9c902 tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "cinder-quobyte-5eec03d6-3346-478b-807b-413c1a033c9e" acquired by "delete_volume" :: waited 0.035s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:58:39 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7516eb4-f328-451b-b1ca-c58806c703fa]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:58:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4a333f0e-9042-4129-ba9f-ee02a6a9c902 tempest-TestInstancesWithCinderVolumes-2036485936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5eec03d6-3346-478b-807b-413c1a033c9e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:39 devstack sudo[103924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5eec03d6-3346-478b-807b-413c1a033c9e Sep 10 19:58:39 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:39 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4a333f0e-9042-4129-ba9f-ee02a6a9c902 tempest-TestInstancesWithCinderVolumes-2036485936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5eec03d6-3346-478b-807b-413c1a033c9e" returned: 0 in 0.540s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4a333f0e-9042-4129-ba9f-ee02a6a9c902 tempest-TestInstancesWithCinderVolumes-2036485936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5eec03d6-3346-478b-807b-413c1a033c9e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:39 devstack sudo[103929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5eec03d6-3346-478b-807b-413c1a033c9e Sep 10 19:58:39 devstack sudo[103929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:39 devstack sudo[103929]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4a333f0e-9042-4129-ba9f-ee02a6a9c902 tempest-TestInstancesWithCinderVolumes-2036485936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5eec03d6-3346-478b-807b-413c1a033c9e" returned: 0 in 0.321s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:39 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4a333f0e-9042-4129-ba9f-ee02a6a9c902 tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "cinder-quobyte-5eec03d6-3346-478b-807b-413c1a033c9e" released by "delete_volume" :: held 0.945s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:58:40 devstack cinder-volume[88093]: WARNING cinder.quota [None req-4a333f0e-9042-4129-ba9f-ee02a6a9c902 tempest-TestInstancesWithCinderVolumes-2036485936 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1554060115-864262417 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1554060115-864262417, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:58:40 devstack cinder-volume[88093]: WARNING cinder.quota [None req-4a333f0e-9042-4129-ba9f-ee02a6a9c902 tempest-TestInstancesWithCinderVolumes-2036485936 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1554060115-864262417 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1554060115-864262417, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:58:40 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-4a333f0e-9042-4129-ba9f-ee02a6a9c902 tempest-TestInstancesWithCinderVolumes-2036485936 None] Created reservations ['0508b4db-7906-4771-b2c8-a989e952d523', 'b2bc836d-8350-4a1b-ac15-311a9ba10851', 'bd5fdf35-086d-447a-9de9-01a4e8ea981d', '1af1507f-026b-4647-b2a8-d47400ee187d'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:58:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-4a333f0e-9042-4129-ba9f-ee02a6a9c902 tempest-TestInstancesWithCinderVolumes-2036485936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:58:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-4a333f0e-9042-4129-ba9f-ee02a6a9c902 tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:58:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-4a333f0e-9042-4129-ba9f-ee02a6a9c902 tempest-TestInstancesWithCinderVolumes-2036485936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:58:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-4a333f0e-9042-4129-ba9f-ee02a6a9c902 tempest-TestInstancesWithCinderVolumes-2036485936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:58:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-4a333f0e-9042-4129-ba9f-ee02a6a9c902 tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:58:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4a333f0e-9042-4129-ba9f-ee02a6a9c902 tempest-TestInstancesWithCinderVolumes-2036485936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:40 devstack sudo[103933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:58:40 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:40 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4a333f0e-9042-4129-ba9f-ee02a6a9c902 tempest-TestInstancesWithCinderVolumes-2036485936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.346s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:40 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-4a333f0e-9042-4129-ba9f-ee02a6a9c902 tempest-TestInstancesWithCinderVolumes-2036485936 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:58:40 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-4a333f0e-9042-4129-ba9f-ee02a6a9c902 tempest-TestInstancesWithCinderVolumes-2036485936 None] Deleted volume successfully. Sep 10 19:58:40 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4a333f0e-9042-4129-ba9f-ee02a6a9c902 tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "cinder-5eec03d6-3346-478b-807b-413c1a033c9e-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:58:43 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-d0e942f4-0471-4b68-a32e-316f5068fe60 req-ccec71b9-df3b-4b88-8b62-119cb504b967 tempest-TestInstancesWithCinderVolumes-2036485936 None] Terminate volume connection completed successfully. Sep 10 19:58:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-d0e942f4-0471-4b68-a32e-316f5068fe60 req-ccec71b9-df3b-4b88-8b62-119cb504b967 tempest-TestInstancesWithCinderVolumes-2036485936 None] Deleting attachment 9fcc2c43-4284-4298-923d-b79a96185642. {{(pid=88093) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 19:58:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f6ab39ea-8bf9-4364-bcf2-e9f400b6933c tempest-TestInstancesWithCinderVolumes-2036485936 None] Acquiring lock "cinder-cbdc1d21-39e6-4d6e-b2ec-90c58f69684e-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:58:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f6ab39ea-8bf9-4364-bcf2-e9f400b6933c tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "cinder-cbdc1d21-39e6-4d6e-b2ec-90c58f69684e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:58:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f6ab39ea-8bf9-4364-bcf2-e9f400b6933c tempest-TestInstancesWithCinderVolumes-2036485936 None] Acquiring lock "cinder-quobyte-cbdc1d21-39e6-4d6e-b2ec-90c58f69684e" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:58:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f6ab39ea-8bf9-4364-bcf2-e9f400b6933c tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "cinder-quobyte-cbdc1d21-39e6-4d6e-b2ec-90c58f69684e" acquired by "delete_volume" :: waited 0.021s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:58:44 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[429f6c60-1243-4faf-8c83-c600b51277dc]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:58:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f6ab39ea-8bf9-4364-bcf2-e9f400b6933c tempest-TestInstancesWithCinderVolumes-2036485936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-cbdc1d21-39e6-4d6e-b2ec-90c58f69684e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:44 devstack sudo[103960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-cbdc1d21-39e6-4d6e-b2ec-90c58f69684e Sep 10 19:58:44 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:44 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f6ab39ea-8bf9-4364-bcf2-e9f400b6933c tempest-TestInstancesWithCinderVolumes-2036485936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-cbdc1d21-39e6-4d6e-b2ec-90c58f69684e" returned: 0 in 0.427s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f6ab39ea-8bf9-4364-bcf2-e9f400b6933c tempest-TestInstancesWithCinderVolumes-2036485936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-cbdc1d21-39e6-4d6e-b2ec-90c58f69684e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:44 devstack sudo[103966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-cbdc1d21-39e6-4d6e-b2ec-90c58f69684e Sep 10 19:58:44 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:45 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f6ab39ea-8bf9-4364-bcf2-e9f400b6933c tempest-TestInstancesWithCinderVolumes-2036485936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-cbdc1d21-39e6-4d6e-b2ec-90c58f69684e" returned: 0 in 0.310s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:45 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f6ab39ea-8bf9-4364-bcf2-e9f400b6933c tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "cinder-quobyte-cbdc1d21-39e6-4d6e-b2ec-90c58f69684e" released by "delete_volume" :: held 0.809s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:58:45 devstack cinder-volume[88093]: WARNING cinder.quota [None req-f6ab39ea-8bf9-4364-bcf2-e9f400b6933c tempest-TestInstancesWithCinderVolumes-2036485936 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-502459991-1650102243 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-502459991-1650102243, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:58:45 devstack cinder-volume[88093]: WARNING cinder.quota [None req-f6ab39ea-8bf9-4364-bcf2-e9f400b6933c tempest-TestInstancesWithCinderVolumes-2036485936 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-502459991-1650102243 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-502459991-1650102243, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:58:45 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-f6ab39ea-8bf9-4364-bcf2-e9f400b6933c tempest-TestInstancesWithCinderVolumes-2036485936 None] Created reservations ['12482942-2478-4b63-9734-050e0842ff83', '9f6ba4ca-ce7a-4dbc-a582-aa803dea303c', '60790c3f-dea2-4b3c-bae6-0147f95e070a', 'a6cf6b75-ce40-4cae-8beb-1d208fca702d'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:58:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f6ab39ea-8bf9-4364-bcf2-e9f400b6933c tempest-TestInstancesWithCinderVolumes-2036485936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:58:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f6ab39ea-8bf9-4364-bcf2-e9f400b6933c tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:58:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f6ab39ea-8bf9-4364-bcf2-e9f400b6933c tempest-TestInstancesWithCinderVolumes-2036485936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:58:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f6ab39ea-8bf9-4364-bcf2-e9f400b6933c tempest-TestInstancesWithCinderVolumes-2036485936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:58:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f6ab39ea-8bf9-4364-bcf2-e9f400b6933c tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:58:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f6ab39ea-8bf9-4364-bcf2-e9f400b6933c tempest-TestInstancesWithCinderVolumes-2036485936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:45 devstack sudo[103969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:58:45 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:45 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f6ab39ea-8bf9-4364-bcf2-e9f400b6933c tempest-TestInstancesWithCinderVolumes-2036485936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.312s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:45 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-f6ab39ea-8bf9-4364-bcf2-e9f400b6933c tempest-TestInstancesWithCinderVolumes-2036485936 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:58:45 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-f6ab39ea-8bf9-4364-bcf2-e9f400b6933c tempest-TestInstancesWithCinderVolumes-2036485936 None] Deleted volume successfully. Sep 10 19:58:45 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f6ab39ea-8bf9-4364-bcf2-e9f400b6933c tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "cinder-cbdc1d21-39e6-4d6e-b2ec-90c58f69684e-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:58:55 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=20,cinder:INSERT=7,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:58:55 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:UPDATE=22,cinder:SELECT=16,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:58:56 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-540578e7-b3e7-492c-b517-d65749a59837 req-6089eed2-1695-4c87-b03d-263aa4475d11 tempest-TestInstancesWithCinderVolumes-2036485936 None] Terminate volume connection completed successfully. Sep 10 19:58:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-540578e7-b3e7-492c-b517-d65749a59837 req-6089eed2-1695-4c87-b03d-263aa4475d11 tempest-TestInstancesWithCinderVolumes-2036485936 None] Deleting attachment e60f15e6-06bf-440c-829f-b248e07316ac. {{(pid=88093) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 19:58:57 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d1bed6ec-92ce-4741-9ce7-ab7615d3d84a tempest-TestInstancesWithCinderVolumes-2036485936 None] Acquiring lock "cinder-36759c7f-97b4-4a2b-87c1-d409dc728442-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:58:57 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d1bed6ec-92ce-4741-9ce7-ab7615d3d84a tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "cinder-36759c7f-97b4-4a2b-87c1-d409dc728442-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:58:57 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d1bed6ec-92ce-4741-9ce7-ab7615d3d84a tempest-TestInstancesWithCinderVolumes-2036485936 None] Acquiring lock "cinder-quobyte-36759c7f-97b4-4a2b-87c1-d409dc728442" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 19:58:57 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d1bed6ec-92ce-4741-9ce7-ab7615d3d84a tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "cinder-quobyte-36759c7f-97b4-4a2b-87c1-d409dc728442" acquired by "delete_volume" :: waited 0.020s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 19:58:57 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[624a28cc-731b-43fd-91e5-05ccd8e5ae83]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:58:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d1bed6ec-92ce-4741-9ce7-ab7615d3d84a tempest-TestInstancesWithCinderVolumes-2036485936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-36759c7f-97b4-4a2b-87c1-d409dc728442 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:57 devstack sudo[104011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-36759c7f-97b4-4a2b-87c1-d409dc728442 Sep 10 19:58:57 devstack sudo[104011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:58 devstack sudo[104011]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d1bed6ec-92ce-4741-9ce7-ab7615d3d84a tempest-TestInstancesWithCinderVolumes-2036485936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-36759c7f-97b4-4a2b-87c1-d409dc728442" returned: 0 in 0.455s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d1bed6ec-92ce-4741-9ce7-ab7615d3d84a tempest-TestInstancesWithCinderVolumes-2036485936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-36759c7f-97b4-4a2b-87c1-d409dc728442 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:58 devstack sudo[104016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-36759c7f-97b4-4a2b-87c1-d409dc728442 Sep 10 19:58:58 devstack sudo[104016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:58 devstack sudo[104016]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d1bed6ec-92ce-4741-9ce7-ab7615d3d84a tempest-TestInstancesWithCinderVolumes-2036485936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-36759c7f-97b4-4a2b-87c1-d409dc728442" returned: 0 in 0.371s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:58 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d1bed6ec-92ce-4741-9ce7-ab7615d3d84a tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "cinder-quobyte-36759c7f-97b4-4a2b-87c1-d409dc728442" released by "delete_volume" :: held 0.888s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:58:58 devstack cinder-volume[88093]: WARNING cinder.quota [None req-d1bed6ec-92ce-4741-9ce7-ab7615d3d84a tempest-TestInstancesWithCinderVolumes-2036485936 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1760778107-89587457 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1760778107-89587457, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:58:58 devstack cinder-volume[88093]: WARNING cinder.quota [None req-d1bed6ec-92ce-4741-9ce7-ab7615d3d84a tempest-TestInstancesWithCinderVolumes-2036485936 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1760778107-89587457 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1760778107-89587457, it is now deprecated. Please use the default quota class for default quota. Sep 10 19:58:58 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-d1bed6ec-92ce-4741-9ce7-ab7615d3d84a tempest-TestInstancesWithCinderVolumes-2036485936 None] Created reservations ['eda45f92-1247-410a-843c-eadfdb66a0e7', '498f5e12-98c2-493f-b73e-59e9fc99869e', 'ff377962-7bbf-41a5-8469-337573dd0a19', 'fa63c2c8-f81b-46e2-97e9-c247de0dab0e'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 19:58:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d1bed6ec-92ce-4741-9ce7-ab7615d3d84a tempest-TestInstancesWithCinderVolumes-2036485936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:58:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d1bed6ec-92ce-4741-9ce7-ab7615d3d84a tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:58:58 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d1bed6ec-92ce-4741-9ce7-ab7615d3d84a tempest-TestInstancesWithCinderVolumes-2036485936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:58:58 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d1bed6ec-92ce-4741-9ce7-ab7615d3d84a tempest-TestInstancesWithCinderVolumes-2036485936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:58:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d1bed6ec-92ce-4741-9ce7-ab7615d3d84a tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:58:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d1bed6ec-92ce-4741-9ce7-ab7615d3d84a tempest-TestInstancesWithCinderVolumes-2036485936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:58 devstack sudo[104019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:58:58 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:59 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d1bed6ec-92ce-4741-9ce7-ab7615d3d84a tempest-TestInstancesWithCinderVolumes-2036485936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.343s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:59 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-d1bed6ec-92ce-4741-9ce7-ab7615d3d84a tempest-TestInstancesWithCinderVolumes-2036485936 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:58:59 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-d1bed6ec-92ce-4741-9ce7-ab7615d3d84a tempest-TestInstancesWithCinderVolumes-2036485936 None] Deleted volume successfully. Sep 10 19:58:59 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d1bed6ec-92ce-4741-9ce7-ab7615d3d84a tempest-TestInstancesWithCinderVolumes-2036485936 None] Lock "cinder-36759c7f-97b4-4a2b-87c1-d409dc728442-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 19:59:03 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:59:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:59:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:59:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:59:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:59:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:59:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:59:04 devstack sudo[104051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 19:59:04 devstack sudo[104051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:59:04 devstack sudo[104051]: pam_unix(sudo:session): session closed for user root Sep 10 19:59:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.326s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:59:04 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:59:04 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager._thread_info {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:59:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread count: 28 {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 19:59:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread info: [<_MainThread(MainThread, started 138417491665024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 19:59:08 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=5 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:59:09 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=5,cinder:UPDATE=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] Flow 'volume_create_manager' (f57878f3-1cc2-4171-a50f-d7955030302a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ba9923-ef00-494f-8b0c-3f83117fce0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ba9923-ef00-494f-8b0c-3f83117fce0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1903310802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46a51cc3-ea21-41ed-a02a-ee0ab3c00205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ad825d994d44d3bab62bb0df5ebcaf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:59:12Z,use_quota=True,user_id='1a4c2c9408f24a20a56463ccdc93a8af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f4cd52-7daa-4107-9532-052ff1aade79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f4cd52-7daa-4107-9532-052ff1aade79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f955ae00-e1d4-40cf-b42e-f801433de5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f955ae00-e1d4-40cf-b42e-f801433de5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46a51cc3-ea21-41ed-a02a-ee0ab3c00205', 'volume_name': 'volume-46a51cc3-ea21-41ed-a02a-ee0ab3c00205', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8fb5c8e-c7fb-4e41-9e8c-c6beaeeb0005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8fb5c8e-c7fb-4e41-9e8c-c6beaeeb0005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f9c7e4-ce9b-4c12-8cd5-7450fb1799d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:59:12 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] Volume 46a51cc3-ea21-41ed-a02a-ee0ab3c00205: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46a51cc3-ea21-41ed-a02a-ee0ab3c00205', 'volume_size': 1} Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1903310802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46a51cc3-ea21-41ed-a02a-ee0ab3c00205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ad825d994d44d3bab62bb0df5ebcaf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:59:12Z,use_quota=True,user_id='1a4c2c9408f24a20a56463ccdc93a8af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] Creating volume 46a51cc3-ea21-41ed-a02a-ee0ab3c00205 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:59:12 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-46a51cc3-ea21-41ed-a02a-ee0ab3c00205 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:59:12 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-46a51cc3-ea21-41ed-a02a-ee0ab3c00205 1073741824 Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:59:12 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Flow 'volume_create_manager' (c04343c1-3418-4acb-a1b9-e23b6d974374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff1c1ed-f6cf-4b23-a02b-455aa9a6e22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff1c1ed-f6cf-4b23-a02b-455aa9a6e22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-224990091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=834870d5-d4b7-4bea-b90b-deaaa5065975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7fe0ca2def453997f49af06786b98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:59:12Z,use_quota=True,user_id='b8484f63a0e5495bae245d87d5813c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (917719c8-e4ed-49a1-a554-6af7d0170098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (917719c8-e4ed-49a1-a554-6af7d0170098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7ca398-218a-4ae7-a790-39690ebddcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG cinder.image.glance [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Creating Keystone auth plugin from conf {{(pid=88093) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7ca398-218a-4ae7-a790-39690ebddcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '834870d5-d4b7-4bea-b90b-deaaa5065975', 'volume_name': 'volume-834870d5-d4b7-4bea-b90b-deaaa5065975', 'volume_size': 1, 'image_id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cce253731714c6797a2e9bce91009cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'created_at': datetime.datetime(2026, 9, 10, 17, 35, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 35, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (691e3f14-5481-4591-a235-901a2f529ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (691e3f14-5481-4591-a235-901a2f529ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3b8c2b-829c-431e-9834-87210a3c004d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:59:12 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Volume 834870d5-d4b7-4bea-b90b-deaaa5065975: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-834870d5-d4b7-4bea-b90b-deaaa5065975', 'volume_size': 1, 'image_id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cce253731714c6797a2e9bce91009cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'created_at': datetime.datetime(2026, 9, 10, 17, 35, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 35, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 19:59:12 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Trying to clone 834870d5-d4b7-4bea-b90b-deaaa5065975 from image ce7b5bdf-521a-42b1-b62b-e8406ccf342b at location (None, [{'url': 'file:///opt/stack/data/glance/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'metadata': {}}]). {{(pid=88093) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 19:59:13 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Sep 10 19:59:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-46a51cc3-ea21-41ed-a02a-ee0ab3c00205 1073741824" returned: 0 in 0.599s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:59:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-46a51cc3-ea21-41ed-a02a-ee0ab3c00205 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:59:13 devstack sudo[104133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-46a51cc3-ea21-41ed-a02a-ee0ab3c00205 Sep 10 19:59:13 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:59:13 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_ljk4lffidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88093) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 19:59:13 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Image download 20.69 MB at 20.69 MB/s Sep 10 19:59:13 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[16990671-ea69-4908-8e98-9c1fe6a38f2d]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:59:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_ljk4lffidevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:59:13 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root Sep 10 19:59:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-46a51cc3-ea21-41ed-a02a-ee0ab3c00205" returned: 0 in 0.433s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:59:13 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:59:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:59:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f9c7e4-ce9b-4c12-8cd5-7450fb1799d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46a51cc3-ea21-41ed-a02a-ee0ab3c00205', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:59:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ecbba51-4ee3-4fe9-9966-23c8695ad492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:59:13 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] Volume volume-46a51cc3-ea21-41ed-a02a-ee0ab3c00205 (46a51cc3-ea21-41ed-a02a-ee0ab3c00205): created successfully Sep 10 19:59:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ecbba51-4ee3-4fe9-9966-23c8695ad492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:59:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] Flow 'volume_create_manager' (f57878f3-1cc2-4171-a50f-d7955030302a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:59:13 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-402c7246-ed68-45ba-8ce6-fc6d88c28c2d tempest-TestMinimumBasicScenario-1235475036 None] Created volume successfully. Sep 10 19:59:13 devstack sudo[104136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_ljk4lffidevstack@QuobyteHD Sep 10 19:59:13 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:59:13 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root Sep 10 19:59:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_ljk4lffidevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:59:13 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Temporary image ce7b5bdf-521a-42b1-b62b-e8406ccf342b is fetched for user b8484f63a0e5495bae245d87d5813c4e. {{(pid=88093) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 19:59:13 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[187754e9-1a52-490e-abdf-6d003e56e7fa]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:59:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_ljk4lffidevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:59:14 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_ljk4lffidevstack@QuobyteHD Sep 10 19:59:14 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:59:14 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Sep 10 19:59:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_ljk4lffidevstack@QuobyteHD" returned: 0 in 0.470s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:59:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:59:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:59:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-224990091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=834870d5-d4b7-4bea-b90b-deaaa5065975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7fe0ca2def453997f49af06786b98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:59:12Z,use_quota=True,user_id='b8484f63a0e5495bae245d87d5813c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:59:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Creating volume 834870d5-d4b7-4bea-b90b-deaaa5065975 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:59:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:59:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:59:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:59:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:59:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:59:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:59:14 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:59:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-834870d5-d4b7-4bea-b90b-deaaa5065975 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:59:14 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-834870d5-d4b7-4bea-b90b-deaaa5065975 1073741824 Sep 10 19:59:14 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:59:15 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Sep 10 19:59:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-834870d5-d4b7-4bea-b90b-deaaa5065975 1073741824" returned: 0 in 0.885s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:59:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-834870d5-d4b7-4bea-b90b-deaaa5065975 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:59:15 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-834870d5-d4b7-4bea-b90b-deaaa5065975 Sep 10 19:59:15 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:59:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-abe24e12-e4f7-4688-9870-b44513909fee req-dd6325be-b516-4365-bc85-715fb4cff17b tempest-TestMinimumBasicScenario-1235475036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:59:15 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Sep 10 19:59:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-834870d5-d4b7-4bea-b90b-deaaa5065975" returned: 0 in 0.277s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:59:15 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:59:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:59:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-abe24e12-e4f7-4688-9870-b44513909fee req-dd6325be-b516-4365-bc85-715fb4cff17b tempest-TestMinimumBasicScenario-1235475036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.113s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:59:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-abe24e12-e4f7-4688-9870-b44513909fee req-dd6325be-b516-4365-bc85-715fb4cff17b tempest-TestMinimumBasicScenario-1235475036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:59:15 devstack cinder-volume[88093]: DEBUG cinder.volume.volume_utils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Attempting download of ce7b5bdf-521a-42b1-b62b-e8406ccf342b ((None, [{'url': 'file:///opt/stack/data/glance/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'metadata': {}}])) to volume 834870d5-d4b7-4bea-b90b-deaaa5065975. {{(pid=88093) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 19:59:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-abe24e12-e4f7-4688-9870-b44513909fee req-dd6325be-b516-4365-bc85-715fb4cff17b tempest-TestMinimumBasicScenario-1235475036 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3', 'name': 'volume-46a51cc3-ea21-41ed-a02a-ee0ab3c00205', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '91ecd930-207d-464a-9b72-03e6dfcdab95', 'enforce_multipath': True} {{(pid=88093) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 19:59:15 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcd4608-c286-49fc-a2e6-2ebe15cccf30]: (4, 'raw') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:59:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_6ryzlvg8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:59:15 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-abe24e12-e4f7-4688-9870-b44513909fee req-dd6325be-b516-4365-bc85-715fb4cff17b tempest-TestMinimumBasicScenario-1235475036 None] attachment_update completed successfully. Sep 10 19:59:15 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_6ryzlvg8 Sep 10 19:59:15 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:59:16 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Sep 10 19:59:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_6ryzlvg8" returned: 0 in 0.508s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:59:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_6ryzlvg8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:59:16 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_6ryzlvg8 Sep 10 19:59:16 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:59:16 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Sep 10 19:59:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_6ryzlvg8" returned: 1 in 0.407s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:59:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_6ryzlvg8' failed. Not Retrying. {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 19:59:16 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[97218f6d-9678-41c9-82bd-0cec29df8a52]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:59:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_ljk4lffidevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:59:16 devstack sudo[104561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_ljk4lffidevstack@QuobyteHD Sep 10 19:59:16 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:59:17 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root Sep 10 19:59:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_ljk4lffidevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:59:17 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] ce7b5bdf-521a-42b1-b62b-e8406ccf342b was qcow2, converting to qcow2 {{(pid=88093) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 19:59:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_ljk4lffidevstack@QuobyteHD /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-834870d5-d4b7-4bea-b90b-deaaa5065975 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:59:17 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_ljk4lffidevstack@QuobyteHD /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-834870d5-d4b7-4bea-b90b-deaaa5065975 Sep 10 19:59:17 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:59:19 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Sep 10 19:59:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_ljk4lffidevstack@QuobyteHD /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-834870d5-d4b7-4bea-b90b-deaaa5065975" returned: 0 in 2.425s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:59:19 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ce7b5bdf-521a-42b1-b62b-e8406ccf342b_ljk4lffidevstack@QuobyteHD, size 112.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-834870d5-d4b7-4bea-b90b-deaaa5065975 {{(pid=88093) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 19:59:19 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Converted 112.00 MB image at 46.15 MB/s Sep 10 19:59:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-834870d5-d4b7-4bea-b90b-deaaa5065975 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:59:19 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-834870d5-d4b7-4bea-b90b-deaaa5065975 1G Sep 10 19:59:19 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:59:20 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Sep 10 19:59:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-834870d5-d4b7-4bea-b90b-deaaa5065975 1G" returned: 0 in 0.490s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:59:20 devstack cinder-volume[88093]: DEBUG cinder.volume.volume_utils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Downloaded image ce7b5bdf-521a-42b1-b62b-e8406ccf342b ((None, [{'url': 'file:///opt/stack/data/glance/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'metadata': {}}])) to volume 834870d5-d4b7-4bea-b90b-deaaa5065975 successfully. {{(pid=88093) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 19:59:20 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Temporary image ce7b5bdf-521a-42b1-b62b-e8406ccf342b for user b8484f63a0e5495bae245d87d5813c4e is deleted. {{(pid=88093) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 19:59:20 devstack cinder-volume[88093]: DEBUG cinder.volume.volume_utils [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Marking volume 834870d5-d4b7-4bea-b90b-deaaa5065975 as bootable. {{(pid=88093) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 19:59:20 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Copying metadata from image ce7b5bdf-521a-42b1-b62b-e8406ccf342b to 834870d5-d4b7-4bea-b90b-deaaa5065975. {{(pid=88093) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 19:59:20 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Creating volume glance metadata for volume 834870d5-d4b7-4bea-b90b-deaaa5065975 backed by image ce7b5bdf-521a-42b1-b62b-e8406ccf342b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88093) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 19:59:20 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3b8c2b-829c-431e-9834-87210a3c004d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-834870d5-d4b7-4bea-b90b-deaaa5065975', 'volume_size': 1, 'image_id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cce253731714c6797a2e9bce91009cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ce7b5bdf-521a-42b1-b62b-e8406ccf342b', 'created_at': datetime.datetime(2026, 9, 10, 17, 35, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 35, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce7b5bdf-521a-42b1-b62b-e8406ccf342b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:59:20 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d8ca55-de10-4215-89d0-4c311d86b763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:59:20 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Volume volume-834870d5-d4b7-4bea-b90b-deaaa5065975 (834870d5-d4b7-4bea-b90b-deaaa5065975): created successfully Sep 10 19:59:20 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d8ca55-de10-4215-89d0-4c311d86b763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:59:20 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Flow 'volume_create_manager' (c04343c1-3418-4acb-a1b9-e23b6d974374) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:59:20 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-a9f51148-ccf9-4b8e-bda1-013fee3c223d tempest-TestShelveInstance-175181298 None] Created volume successfully. Sep 10 19:59:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-20cfec03-11a1-426d-9eb7-34aefeda7f49 req-9934fe95-6df2-4506-b71b-f8740f7fa7e8 tempest-TestShelveInstance-175181298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:59:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-20cfec03-11a1-426d-9eb7-34aefeda7f49 req-9934fe95-6df2-4506-b71b-f8740f7fa7e8 tempest-TestShelveInstance-175181298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:59:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-20cfec03-11a1-426d-9eb7-34aefeda7f49 req-9934fe95-6df2-4506-b71b-f8740f7fa7e8 tempest-TestShelveInstance-175181298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:59:26 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-20cfec03-11a1-426d-9eb7-34aefeda7f49 req-9934fe95-6df2-4506-b71b-f8740f7fa7e8 tempest-TestShelveInstance-175181298 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3', 'name': 'volume-834870d5-d4b7-4bea-b90b-deaaa5065975', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cfbf4fa0-0d00-481c-ba26-c66b958edff4', 'enforce_multipath': True} {{(pid=88093) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 19:59:26 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-20cfec03-11a1-426d-9eb7-34aefeda7f49 req-9934fe95-6df2-4506-b71b-f8740f7fa7e8 tempest-TestShelveInstance-175181298 None] attachment_update completed successfully. Sep 10 19:59:36 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=26,cinder:UPDATE=10,cinder:INSERT=7,cinder:DELETE=1 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:59:36 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:UPDATE=11,cinder:SELECT=23,cinder:INSERT=8,cinder:DELETE=1 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:59:48 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 19:59:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] Flow 'volume_create_manager' (9e30ce79-5d30-440d-824a-32879ab02400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:59:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aeaadcf-6f6d-420f-ad85-bcb86e4f86cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:59:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aeaadcf-6f6d-420f-ad85-bcb86e4f86cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1629294683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e274c127-fc00-4928-a51a-8b174c3fdd08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0a3cb35c78494abce506c1ad9c69f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:59:48Z,use_quota=True,user_id='db28ca7be7d54dd18ae9e4f8eeb3c7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:59:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (710eba4b-9731-4c4c-afdb-50cc8d04bf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:59:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (710eba4b-9731-4c4c-afdb-50cc8d04bf87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:59:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5b8e2b1-e282-44ae-ad43-1e1ae2157193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:59:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5b8e2b1-e282-44ae-ad43-1e1ae2157193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e274c127-fc00-4928-a51a-8b174c3fdd08', 'volume_name': 'volume-e274c127-fc00-4928-a51a-8b174c3fdd08', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:59:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ea6ff4-7416-4b31-bb98-547d91c4d80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:59:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ea6ff4-7416-4b31-bb98-547d91c4d80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:59:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca282357-66fe-4c57-ac5f-e52584fe16e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:59:48 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] Volume e274c127-fc00-4928-a51a-8b174c3fdd08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e274c127-fc00-4928-a51a-8b174c3fdd08', 'volume_size': 1} Sep 10 19:59:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:59:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:59:48 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T17:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1629294683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e274c127-fc00-4928-a51a-8b174c3fdd08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0a3cb35c78494abce506c1ad9c69f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T17:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T17:59:48Z,use_quota=True,user_id='db28ca7be7d54dd18ae9e4f8eeb3c7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 19:59:48 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] Creating volume e274c127-fc00-4928-a51a-8b174c3fdd08 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 19:59:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:59:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:59:48 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 19:59:48 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 19:59:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:59:48 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 19:59:48 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 19:59:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e274c127-fc00-4928-a51a-8b174c3fdd08 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:59:48 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e274c127-fc00-4928-a51a-8b174c3fdd08 1073741824 Sep 10 19:59:48 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:59:48 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Sep 10 19:59:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e274c127-fc00-4928-a51a-8b174c3fdd08 1073741824" returned: 0 in 0.503s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:59:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e274c127-fc00-4928-a51a-8b174c3fdd08 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:59:48 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e274c127-fc00-4928-a51a-8b174c3fdd08 Sep 10 19:59:48 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:59:49 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Sep 10 19:59:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e274c127-fc00-4928-a51a-8b174c3fdd08" returned: 0 in 0.288s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:59:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 19:59:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 19:59:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca282357-66fe-4c57-ac5f-e52584fe16e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e274c127-fc00-4928-a51a-8b174c3fdd08', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:59:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a5a2ed4-8d2c-43cb-9761-f4fe3eebcb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 19:59:49 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] Volume volume-e274c127-fc00-4928-a51a-8b174c3fdd08 (e274c127-fc00-4928-a51a-8b174c3fdd08): created successfully Sep 10 19:59:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a5a2ed4-8d2c-43cb-9761-f4fe3eebcb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 19:59:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] Flow 'volume_create_manager' (9e30ce79-5d30-440d-824a-32879ab02400) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 19:59:49 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-1b5f6e5c-73d1-4882-b4ec-a90dbf4c278a tempest-TestImageHashVerification-16132966 None] Created volume successfully. Sep 10 19:59:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5838f77c-ccd3-4fbd-be89-a5738bb56fc9 tempest-TestImageHashVerification-16132966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 19:59:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5838f77c-ccd3-4fbd-be89-a5738bb56fc9 tempest-TestImageHashVerification-16132966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 19:59:51 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[6742d57b-781d-4182-a5f2-8bd7169ca5c2]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:59:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5838f77c-ccd3-4fbd-be89-a5738bb56fc9 tempest-TestImageHashVerification-16132966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e274c127-fc00-4928-a51a-8b174c3fdd08 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:59:51 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e274c127-fc00-4928-a51a-8b174c3fdd08 Sep 10 19:59:51 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:59:51 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Sep 10 19:59:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5838f77c-ccd3-4fbd-be89-a5738bb56fc9 tempest-TestImageHashVerification-16132966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e274c127-fc00-4928-a51a-8b174c3fdd08" returned: 0 in 0.379s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:59:51 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[880a0b6b-c847-4bf0-9033-d5922918ffe6]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:59:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5838f77c-ccd3-4fbd-be89-a5738bb56fc9 tempest-TestImageHashVerification-16132966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e274c127-fc00-4928-a51a-8b174c3fdd08 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:59:51 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e274c127-fc00-4928-a51a-8b174c3fdd08 Sep 10 19:59:51 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:59:52 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Sep 10 19:59:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5838f77c-ccd3-4fbd-be89-a5738bb56fc9 tempest-TestImageHashVerification-16132966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e274c127-fc00-4928-a51a-8b174c3fdd08" returned: 0 in 0.401s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:59:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5838f77c-ccd3-4fbd-be89-a5738bb56fc9 tempest-TestImageHashVerification-16132966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e274c127-fc00-4928-a51a-8b174c3fdd08 /opt/stack/data/cinder/conversion/e274c127-fc00-4928-a51a-8b174c3fdd08.temp_image.f5603c8c-3c91-4452-a6d9-e28fb071a969jdjo9jdj.img {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:59:52 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e274c127-fc00-4928-a51a-8b174c3fdd08 /opt/stack/data/cinder/conversion/e274c127-fc00-4928-a51a-8b174c3fdd08.temp_image.f5603c8c-3c91-4452-a6d9-e28fb071a969jdjo9jdj.img Sep 10 19:59:52 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:59:56 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Sep 10 19:59:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5838f77c-ccd3-4fbd-be89-a5738bb56fc9 tempest-TestImageHashVerification-16132966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e274c127-fc00-4928-a51a-8b174c3fdd08 /opt/stack/data/cinder/conversion/e274c127-fc00-4928-a51a-8b174c3fdd08.temp_image.f5603c8c-3c91-4452-a6d9-e28fb071a969jdjo9jdj.img" returned: 0 in 3.987s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:59:56 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[a588112d-9573-439a-acbe-7e71a2773d7d]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 19:59:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5838f77c-ccd3-4fbd-be89-a5738bb56fc9 tempest-TestImageHashVerification-16132966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e274c127-fc00-4928-a51a-8b174c3fdd08 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:59:56 devstack sudo[104849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e274c127-fc00-4928-a51a-8b174c3fdd08 Sep 10 19:59:56 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:59:56 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root Sep 10 19:59:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5838f77c-ccd3-4fbd-be89-a5738bb56fc9 tempest-TestImageHashVerification-16132966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e274c127-fc00-4928-a51a-8b174c3fdd08" returned: 0 in 0.496s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:59:56 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-5838f77c-ccd3-4fbd-be89-a5738bb56fc9 tempest-TestImageHashVerification-16132966 None] Image conversion details: src /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e274c127-fc00-4928-a51a-8b174c3fdd08, size 1024.00 MB, duration 3.99 sec, destination /opt/stack/data/cinder/conversion/e274c127-fc00-4928-a51a-8b174c3fdd08.temp_image.f5603c8c-3c91-4452-a6d9-e28fb071a969jdjo9jdj.img {{(pid=88093) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 19:59:56 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-5838f77c-ccd3-4fbd-be89-a5738bb56fc9 tempest-TestImageHashVerification-16132966 None] Converted 1024.00 MB image at 256.78 MB/s Sep 10 19:59:56 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-5838f77c-ccd3-4fbd-be89-a5738bb56fc9 tempest-TestImageHashVerification-16132966 None] f5603c8c-3c91-4452-a6d9-e28fb071a969 was raw, no need to convert to raw {{(pid=88093) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 10 20:00:01 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:00:03 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:00:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:00:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:00:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:04 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:00:04 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:04 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.420s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:04 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:00:04 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager._thread_info {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:00:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread count: 28 {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:00:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread info: [<_MainThread(MainThread, started 138417491665024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:00:06 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-a40210fd-a6b5-4f62-a854-fee0e9bdc698 req-fe85321b-68e9-44f5-8bc2-4fad56072495 tempest-TestMinimumBasicScenario-1235475036 None] Terminate volume connection completed successfully. Sep 10 20:00:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-a40210fd-a6b5-4f62-a854-fee0e9bdc698 req-fe85321b-68e9-44f5-8bc2-4fad56072495 tempest-TestMinimumBasicScenario-1235475036 None] Deleting attachment 91ecd930-207d-464a-9b72-03e6dfcdab95. {{(pid=88093) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 20:00:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cf0c09fd-8395-437b-8d71-7cf7a4ab02b2 tempest-TestMinimumBasicScenario-1235475036 None] Acquiring lock "cinder-46a51cc3-ea21-41ed-a02a-ee0ab3c00205-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:00:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cf0c09fd-8395-437b-8d71-7cf7a4ab02b2 tempest-TestMinimumBasicScenario-1235475036 None] Lock "cinder-46a51cc3-ea21-41ed-a02a-ee0ab3c00205-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:00:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cf0c09fd-8395-437b-8d71-7cf7a4ab02b2 tempest-TestMinimumBasicScenario-1235475036 None] Acquiring lock "cinder-quobyte-46a51cc3-ea21-41ed-a02a-ee0ab3c00205" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:00:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cf0c09fd-8395-437b-8d71-7cf7a4ab02b2 tempest-TestMinimumBasicScenario-1235475036 None] Lock "cinder-quobyte-46a51cc3-ea21-41ed-a02a-ee0ab3c00205" acquired by "delete_volume" :: waited 0.018s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:00:07 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ee86ed-9600-4a64-bd4b-2057207a739c]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:00:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf0c09fd-8395-437b-8d71-7cf7a4ab02b2 tempest-TestMinimumBasicScenario-1235475036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-46a51cc3-ea21-41ed-a02a-ee0ab3c00205 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:07 devstack sudo[104882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-46a51cc3-ea21-41ed-a02a-ee0ab3c00205 Sep 10 20:00:07 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:07 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf0c09fd-8395-437b-8d71-7cf7a4ab02b2 tempest-TestMinimumBasicScenario-1235475036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-46a51cc3-ea21-41ed-a02a-ee0ab3c00205" returned: 0 in 0.381s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf0c09fd-8395-437b-8d71-7cf7a4ab02b2 tempest-TestMinimumBasicScenario-1235475036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-46a51cc3-ea21-41ed-a02a-ee0ab3c00205 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:07 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-46a51cc3-ea21-41ed-a02a-ee0ab3c00205 Sep 10 20:00:07 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:07 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf0c09fd-8395-437b-8d71-7cf7a4ab02b2 tempest-TestMinimumBasicScenario-1235475036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-46a51cc3-ea21-41ed-a02a-ee0ab3c00205" returned: 0 in 0.266s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cf0c09fd-8395-437b-8d71-7cf7a4ab02b2 tempest-TestMinimumBasicScenario-1235475036 None] Lock "cinder-quobyte-46a51cc3-ea21-41ed-a02a-ee0ab3c00205" released by "delete_volume" :: held 0.734s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:00:07 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-cf0c09fd-8395-437b-8d71-7cf7a4ab02b2 tempest-TestMinimumBasicScenario-1235475036 None] Created reservations ['a5f71c83-3330-40c1-9145-d73b362aee3d', 'a105a20f-7f00-436d-a610-b5fbeb8e72dd', 'beee865a-a3a4-44ef-ad50-3eeb8040e0fd', '343a3e3a-5de6-4bdd-8372-b4102c134a63'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:00:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cf0c09fd-8395-437b-8d71-7cf7a4ab02b2 tempest-TestMinimumBasicScenario-1235475036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cf0c09fd-8395-437b-8d71-7cf7a4ab02b2 tempest-TestMinimumBasicScenario-1235475036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-cf0c09fd-8395-437b-8d71-7cf7a4ab02b2 tempest-TestMinimumBasicScenario-1235475036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:00:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-cf0c09fd-8395-437b-8d71-7cf7a4ab02b2 tempest-TestMinimumBasicScenario-1235475036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:00:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cf0c09fd-8395-437b-8d71-7cf7a4ab02b2 tempest-TestMinimumBasicScenario-1235475036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf0c09fd-8395-437b-8d71-7cf7a4ab02b2 tempest-TestMinimumBasicScenario-1235475036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:08 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:00:08 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:08 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cf0c09fd-8395-437b-8d71-7cf7a4ab02b2 tempest-TestMinimumBasicScenario-1235475036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.379s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:08 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-cf0c09fd-8395-437b-8d71-7cf7a4ab02b2 tempest-TestMinimumBasicScenario-1235475036 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:00:08 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-cf0c09fd-8395-437b-8d71-7cf7a4ab02b2 tempest-TestMinimumBasicScenario-1235475036 None] Deleted volume successfully. Sep 10 20:00:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cf0c09fd-8395-437b-8d71-7cf7a4ab02b2 tempest-TestMinimumBasicScenario-1235475036 None] Lock "cinder-46a51cc3-ea21-41ed-a02a-ee0ab3c00205-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:00:17 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-334dc9f2-f014-44e0-849a-de8e6e3258c1 req-1a95602e-f798-4ae9-a0ea-de71052804d9 tempest-TestShelveInstance-175181298 None] Terminate volume connection completed successfully. Sep 10 20:00:17 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-334dc9f2-f014-44e0-849a-de8e6e3258c1 req-1a95602e-f798-4ae9-a0ea-de71052804d9 tempest-TestShelveInstance-175181298 None] Deleting attachment cfbf4fa0-0d00-481c-ba26-c66b958edff4. {{(pid=88093) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 20:00:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5838f77c-ccd3-4fbd-be89-a5738bb56fc9 tempest-TestImageHashVerification-16132966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.148s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:19 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5838f77c-ccd3-4fbd-be89-a5738bb56fc9 tempest-TestImageHashVerification-16132966 None] Uploaded volume to glance image-id: f5603c8c-3c91-4452-a6d9-e28fb071a969. {{(pid=88093) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 10 20:00:19 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-5838f77c-ccd3-4fbd-be89-a5738bb56fc9 tempest-TestImageHashVerification-16132966 None] Copy volume to image completed successfully. Sep 10 20:00:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-c1792c66-d1d3-48fa-b8b2-a7c90bad90af req-da6175c4-8afd-498b-805c-35f6876b12d1 tempest-TestShelveInstance-175181298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-c1792c66-d1d3-48fa-b8b2-a7c90bad90af req-da6175c4-8afd-498b-805c-35f6876b12d1 tempest-TestShelveInstance-175181298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-c1792c66-d1d3-48fa-b8b2-a7c90bad90af req-da6175c4-8afd-498b-805c-35f6876b12d1 tempest-TestShelveInstance-175181298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:20 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-c1792c66-d1d3-48fa-b8b2-a7c90bad90af req-da6175c4-8afd-498b-805c-35f6876b12d1 tempest-TestShelveInstance-175181298 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3', 'name': 'volume-834870d5-d4b7-4bea-b90b-deaaa5065975', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cd9307a2-37ea-4c06-a864-e90971ddfffb', 'enforce_multipath': True} {{(pid=88093) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 20:00:20 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-c1792c66-d1d3-48fa-b8b2-a7c90bad90af req-da6175c4-8afd-498b-805c-35f6876b12d1 tempest-TestShelveInstance-175181298 None] attachment_update completed successfully. Sep 10 20:00:20 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5d2ca4f4-1163-4c4e-b5e5-83e131660e44 tempest-TestImageHashVerification-16132966 None] Acquiring lock "cinder-e274c127-fc00-4928-a51a-8b174c3fdd08-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:00:20 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5d2ca4f4-1163-4c4e-b5e5-83e131660e44 tempest-TestImageHashVerification-16132966 None] Lock "cinder-e274c127-fc00-4928-a51a-8b174c3fdd08-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:00:20 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5d2ca4f4-1163-4c4e-b5e5-83e131660e44 tempest-TestImageHashVerification-16132966 None] Acquiring lock "cinder-quobyte-e274c127-fc00-4928-a51a-8b174c3fdd08" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:00:20 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5d2ca4f4-1163-4c4e-b5e5-83e131660e44 tempest-TestImageHashVerification-16132966 None] Lock "cinder-quobyte-e274c127-fc00-4928-a51a-8b174c3fdd08" acquired by "delete_volume" :: waited 0.015s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:00:20 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bc4337-cf8c-4bf0-ab13-fd4bc60987b9]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:00:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5d2ca4f4-1163-4c4e-b5e5-83e131660e44 tempest-TestImageHashVerification-16132966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e274c127-fc00-4928-a51a-8b174c3fdd08 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:20 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e274c127-fc00-4928-a51a-8b174c3fdd08 Sep 10 20:00:20 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:20 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5d2ca4f4-1163-4c4e-b5e5-83e131660e44 tempest-TestImageHashVerification-16132966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e274c127-fc00-4928-a51a-8b174c3fdd08" returned: 0 in 0.380s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5d2ca4f4-1163-4c4e-b5e5-83e131660e44 tempest-TestImageHashVerification-16132966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e274c127-fc00-4928-a51a-8b174c3fdd08 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:20 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e274c127-fc00-4928-a51a-8b174c3fdd08 Sep 10 20:00:20 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:21 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5d2ca4f4-1163-4c4e-b5e5-83e131660e44 tempest-TestImageHashVerification-16132966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e274c127-fc00-4928-a51a-8b174c3fdd08" returned: 0 in 0.348s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:21 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5d2ca4f4-1163-4c4e-b5e5-83e131660e44 tempest-TestImageHashVerification-16132966 None] Lock "cinder-quobyte-e274c127-fc00-4928-a51a-8b174c3fdd08" released by "delete_volume" :: held 0.781s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:00:21 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-5d2ca4f4-1163-4c4e-b5e5-83e131660e44 tempest-TestImageHashVerification-16132966 None] Created reservations ['cf42c627-0409-43fb-8ee8-73d1a0d2db8e', '029a7759-295b-4d10-abf8-eebd684c9d7d', 'af7ef77a-f1db-492e-b2dd-358d95f05a81', '554e45f0-2925-423f-9214-3483cb2c5792'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:00:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5d2ca4f4-1163-4c4e-b5e5-83e131660e44 tempest-TestImageHashVerification-16132966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5d2ca4f4-1163-4c4e-b5e5-83e131660e44 tempest-TestImageHashVerification-16132966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:21 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5d2ca4f4-1163-4c4e-b5e5-83e131660e44 tempest-TestImageHashVerification-16132966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:00:21 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5d2ca4f4-1163-4c4e-b5e5-83e131660e44 tempest-TestImageHashVerification-16132966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:00:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5d2ca4f4-1163-4c4e-b5e5-83e131660e44 tempest-TestImageHashVerification-16132966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5d2ca4f4-1163-4c4e-b5e5-83e131660e44 tempest-TestImageHashVerification-16132966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:21 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:00:21 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:21 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5d2ca4f4-1163-4c4e-b5e5-83e131660e44 tempest-TestImageHashVerification-16132966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.341s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:21 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-5d2ca4f4-1163-4c4e-b5e5-83e131660e44 tempest-TestImageHashVerification-16132966 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:00:21 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-5d2ca4f4-1163-4c4e-b5e5-83e131660e44 tempest-TestImageHashVerification-16132966 None] Deleted volume successfully. Sep 10 20:00:21 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5d2ca4f4-1163-4c4e-b5e5-83e131660e44 tempest-TestImageHashVerification-16132966 None] Lock "cinder-e274c127-fc00-4928-a51a-8b174c3fdd08-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:00:27 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:00:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Flow 'volume_create_manager' (dc31770a-af61-451f-88ca-f367c4c89a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:00:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d00581-aade-4b59-b757-e8175c122148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d00581-aade-4b59-b757-e8175c122148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-578153635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4957387a-8de4-4eeb-9f32-a774465ccb03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c336bb46679464babe7f0a8ffa1a2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:00:27Z,use_quota=True,user_id='ca8b1968fa2942f9a32dff3f794f11e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d8fdd32-0860-4759-9517-eb2079089057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d8fdd32-0860-4759-9517-eb2079089057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f54fa45-8297-4f43-82b9-2462d197c381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f54fa45-8297-4f43-82b9-2462d197c381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4957387a-8de4-4eeb-9f32-a774465ccb03', 'volume_name': 'volume-4957387a-8de4-4eeb-9f32-a774465ccb03', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e0cdc6-eca8-476c-bff4-8b3e2a3d5e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e0cdc6-eca8-476c-bff4-8b3e2a3d5e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b46b66-b030-470d-979c-3b9b90beff41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:27 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Volume 4957387a-8de4-4eeb-9f32-a774465ccb03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4957387a-8de4-4eeb-9f32-a774465ccb03', 'volume_size': 1} Sep 10 20:00:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:27 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-578153635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4957387a-8de4-4eeb-9f32-a774465ccb03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c336bb46679464babe7f0a8ffa1a2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:00:27Z,use_quota=True,user_id='ca8b1968fa2942f9a32dff3f794f11e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:00:27 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Creating volume 4957387a-8de4-4eeb-9f32-a774465ccb03 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:00:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:27 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:00:27 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:00:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:27 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:00:27 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:00:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4957387a-8de4-4eeb-9f32-a774465ccb03 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:27 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4957387a-8de4-4eeb-9f32-a774465ccb03 1073741824 Sep 10 20:00:27 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:27 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4957387a-8de4-4eeb-9f32-a774465ccb03 1073741824" returned: 0 in 0.601s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4957387a-8de4-4eeb-9f32-a774465ccb03 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:27 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4957387a-8de4-4eeb-9f32-a774465ccb03 Sep 10 20:00:27 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:28 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4957387a-8de4-4eeb-9f32-a774465ccb03" returned: 0 in 0.292s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:00:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b46b66-b030-470d-979c-3b9b90beff41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4957387a-8de4-4eeb-9f32-a774465ccb03', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f54ea1-479a-4dbd-9a1d-06ee665f7cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:28 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Volume volume-4957387a-8de4-4eeb-9f32-a774465ccb03 (4957387a-8de4-4eeb-9f32-a774465ccb03): created successfully Sep 10 20:00:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f54ea1-479a-4dbd-9a1d-06ee665f7cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Flow 'volume_create_manager' (dc31770a-af61-451f-88ca-f367c4c89a6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:00:28 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-18f05c5a-0d7e-4c83-b185-08ac623c918b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Created volume successfully. Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Flow 'volume_create_manager' (a5850a23-83b1-4325-a4bc-3a088506a67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90858a96-2642-4805-8748-d9fe4aa3578a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90858a96-2642-4805-8748-d9fe4aa3578a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-757568414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9afe40-ab5c-4325-b9f0-95236d08241a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c336bb46679464babe7f0a8ffa1a2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:00:30Z,use_quota=True,user_id='ca8b1968fa2942f9a32dff3f794f11e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13741e6-3f4b-4f8c-bbb9-0d284c660aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13741e6-3f4b-4f8c-bbb9-0d284c660aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9411bb33-baed-4a1f-800f-d817086cea8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9411bb33-baed-4a1f-800f-d817086cea8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac9afe40-ab5c-4325-b9f0-95236d08241a', 'volume_name': 'volume-ac9afe40-ab5c-4325-b9f0-95236d08241a', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (693b1c91-9b0c-4f32-8d31-34b84f2d6f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (693b1c91-9b0c-4f32-8d31-34b84f2d6f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db9019b-fc09-4a04-90e4-d2983abe0155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:30 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Volume ac9afe40-ab5c-4325-b9f0-95236d08241a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac9afe40-ab5c-4325-b9f0-95236d08241a', 'volume_size': 1} Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-757568414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9afe40-ab5c-4325-b9f0-95236d08241a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c336bb46679464babe7f0a8ffa1a2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:00:30Z,use_quota=True,user_id='ca8b1968fa2942f9a32dff3f794f11e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Creating volume ac9afe40-ab5c-4325-b9f0-95236d08241a {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:00:30 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac9afe40-ab5c-4325-b9f0-95236d08241a 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:30 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac9afe40-ab5c-4325-b9f0-95236d08241a 1073741824 Sep 10 20:00:30 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Flow 'volume_create_manager' (5d36327b-21b0-4ff7-8eb2-5e56f27d914e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d55d4f-b4f9-4d64-9933-923a2d2a80a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d55d4f-b4f9-4d64-9933-923a2d2a80a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2101439321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e35f5ae-d253-4398-9267-271c2613fd82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c336bb46679464babe7f0a8ffa1a2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:00:30Z,use_quota=True,user_id='ca8b1968fa2942f9a32dff3f794f11e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcccfc24-6650-4bff-8c5a-4d86858a93b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcccfc24-6650-4bff-8c5a-4d86858a93b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feb38a65-0344-4efd-93c8-5fd73c5f763a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feb38a65-0344-4efd-93c8-5fd73c5f763a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e35f5ae-d253-4398-9267-271c2613fd82', 'volume_name': 'volume-5e35f5ae-d253-4398-9267-271c2613fd82', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75586c12-4f58-4e12-a0bf-3d1ecf5eea7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75586c12-4f58-4e12-a0bf-3d1ecf5eea7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ecdffc8-6243-4d34-99ff-5dd260f4ffda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:30 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Volume 5e35f5ae-d253-4398-9267-271c2613fd82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e35f5ae-d253-4398-9267-271c2613fd82', 'volume_size': 1} Sep 10 20:00:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:00:31 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Flow 'volume_create_manager' (2cb9e7e3-67d0-4c15-a9af-5013232f7d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21237d9a-5945-4542-86cd-160850db5caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac9afe40-ab5c-4325-b9f0-95236d08241a 1073741824" returned: 0 in 1.017s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21237d9a-5945-4542-86cd-160850db5caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1371324719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a28890-d930-496b-b88f-d76fc729e480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c336bb46679464babe7f0a8ffa1a2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:00:31Z,use_quota=True,user_id='ca8b1968fa2942f9a32dff3f794f11e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b9a136-5a53-4c89-a19b-72edd2593583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b9a136-5a53-4c89-a19b-72edd2593583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (516c8d28-ecbc-4ca4-81ac-d3b680926f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (516c8d28-ecbc-4ca4-81ac-d3b680926f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84a28890-d930-496b-b88f-d76fc729e480', 'volume_name': 'volume-84a28890-d930-496b-b88f-d76fc729e480', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e69aa01-9ab9-435a-b3c3-f7f58786fa74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e69aa01-9ab9-435a-b3c3-f7f58786fa74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5f5e55-cee0-46b8-9c1b-6b590033acde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:31 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Volume 84a28890-d930-496b-b88f-d76fc729e480: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84a28890-d930-496b-b88f-d76fc729e480', 'volume_size': 1} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac9afe40-ab5c-4325-b9f0-95236d08241a {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:31 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac9afe40-ab5c-4325-b9f0-95236d08241a Sep 10 20:00:31 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:31 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac9afe40-ab5c-4325-b9f0-95236d08241a" returned: 0 in 0.380s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.011s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2101439321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e35f5ae-d253-4398-9267-271c2613fd82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c336bb46679464babe7f0a8ffa1a2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:00:30Z,use_quota=True,user_id='ca8b1968fa2942f9a32dff3f794f11e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Creating volume 5e35f5ae-d253-4398-9267-271c2613fd82 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:00:31 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5e35f5ae-d253-4398-9267-271c2613fd82 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:00:31 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5e35f5ae-d253-4398-9267-271c2613fd82 1073741824 Sep 10 20:00:31 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Flow 'volume_create_manager' (cd4a63b8-5c42-4d5b-be32-7f7524faa3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b452ac8-e127-4052-b218-06578bce4bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db9019b-fc09-4a04-90e4-d2983abe0155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac9afe40-ab5c-4325-b9f0-95236d08241a', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6470d6e-81dd-45e1-977f-f58eddc4401c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b452ac8-e127-4052-b218-06578bce4bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-246671199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9063ea4e-79f9-4c57-9029-0b4bbc4c3b18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c336bb46679464babe7f0a8ffa1a2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:00:32Z,use_quota=True,user_id='ca8b1968fa2942f9a32dff3f794f11e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f18e1f1-6c39-4035-b160-8cdac37caad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f18e1f1-6c39-4035-b160-8cdac37caad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8927353e-472d-46d1-ba37-7990d5e328fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8927353e-472d-46d1-ba37-7990d5e328fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9063ea4e-79f9-4c57-9029-0b4bbc4c3b18', 'volume_name': 'volume-9063ea4e-79f9-4c57-9029-0b4bbc4c3b18', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (457f07b6-69ac-4909-a265-9d2fc7427431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (457f07b6-69ac-4909-a265-9d2fc7427431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:32 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c93a577-bfa3-45f2-bc77-0fa273808a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:32 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Volume 9063ea4e-79f9-4c57-9029-0b4bbc4c3b18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9063ea4e-79f9-4c57-9029-0b4bbc4c3b18', 'volume_size': 1} Sep 10 20:00:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:32 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Volume volume-ac9afe40-ab5c-4325-b9f0-95236d08241a (ac9afe40-ab5c-4325-b9f0-95236d08241a): created successfully Sep 10 20:00:32 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6470d6e-81dd-45e1-977f-f58eddc4401c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:32 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Flow 'volume_create_manager' (a5850a23-83b1-4325-a4bc-3a088506a67b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:00:32 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-7f1ba929-943a-42c4-a711-11639159be4b tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Created volume successfully. Sep 10 20:00:32 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5e35f5ae-d253-4398-9267-271c2613fd82 1073741824" returned: 0 in 0.707s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:32 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:00:32 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Flow 'volume_create_manager' (1f61c3ab-68c3-4466-89c8-427b70781849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:00:32 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3cda5c0-9778-430c-80b2-4fa08afb02f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:32 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3cda5c0-9778-430c-80b2-4fa08afb02f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1003419699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e939170c-800f-4ddd-8766-5b2cc5b26d26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c336bb46679464babe7f0a8ffa1a2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:00:32Z,use_quota=True,user_id='ca8b1968fa2942f9a32dff3f794f11e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:32 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ad3b6e4-2d8e-4b87-a9c6-72e536236004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:32 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ad3b6e4-2d8e-4b87-a9c6-72e536236004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:32 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3405a039-0e8a-43d4-af76-79e4902e84f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:32 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3405a039-0e8a-43d4-af76-79e4902e84f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e939170c-800f-4ddd-8766-5b2cc5b26d26', 'volume_name': 'volume-e939170c-800f-4ddd-8766-5b2cc5b26d26', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:32 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24bd300-c8eb-4c3d-aa6c-56b30692d9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:32 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24bd300-c8eb-4c3d-aa6c-56b30692d9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:32 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b0ae0b-5c28-4769-b391-d820838cb8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:32 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Volume e939170c-800f-4ddd-8766-5b2cc5b26d26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e939170c-800f-4ddd-8766-5b2cc5b26d26', 'volume_size': 1} Sep 10 20:00:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5e35f5ae-d253-4398-9267-271c2613fd82 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:32 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5e35f5ae-d253-4398-9267-271c2613fd82 Sep 10 20:00:32 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:32 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5e35f5ae-d253-4398-9267-271c2613fd82" returned: 0 in 0.270s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:32 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:00:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.700s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:32 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1371324719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a28890-d930-496b-b88f-d76fc729e480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c336bb46679464babe7f0a8ffa1a2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:00:31Z,use_quota=True,user_id='ca8b1968fa2942f9a32dff3f794f11e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:00:32 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Creating volume 84a28890-d930-496b-b88f-d76fc729e480 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:00:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:32 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:00:32 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:00:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:32 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:00:32 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:00:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-84a28890-d930-496b-b88f-d76fc729e480 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ecdffc8-6243-4d34-99ff-5dd260f4ffda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e35f5ae-d253-4398-9267-271c2613fd82', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f92c6d8-9da9-43d1-862c-b4cdf7d5f31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:33 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-84a28890-d930-496b-b88f-d76fc729e480 1073741824 Sep 10 20:00:33 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:33 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Volume volume-5e35f5ae-d253-4398-9267-271c2613fd82 (5e35f5ae-d253-4398-9267-271c2613fd82): created successfully Sep 10 20:00:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f92c6d8-9da9-43d1-862c-b4cdf7d5f31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Flow 'volume_create_manager' (5d36327b-21b0-4ff7-8eb2-5e56f27d914e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:00:33 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-9d1a009f-358e-485e-affc-08f8b0be1541 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Created volume successfully. Sep 10 20:00:33 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-84a28890-d930-496b-b88f-d76fc729e480 1073741824" returned: 0 in 0.558s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-84a28890-d930-496b-b88f-d76fc729e480 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:33 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-84a28890-d930-496b-b88f-d76fc729e480 Sep 10 20:00:33 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:33 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-84a28890-d930-496b-b88f-d76fc729e480" returned: 0 in 0.252s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:33 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:00:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.851s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:33 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-246671199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9063ea4e-79f9-4c57-9029-0b4bbc4c3b18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c336bb46679464babe7f0a8ffa1a2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:00:32Z,use_quota=True,user_id='ca8b1968fa2942f9a32dff3f794f11e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:00:33 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Creating volume 9063ea4e-79f9-4c57-9029-0b4bbc4c3b18 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:00:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:33 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:00:33 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:00:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:33 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:00:33 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:00:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9063ea4e-79f9-4c57-9029-0b4bbc4c3b18 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5f5e55-cee0-46b8-9c1b-6b590033acde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84a28890-d930-496b-b88f-d76fc729e480', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:33 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9063ea4e-79f9-4c57-9029-0b4bbc4c3b18 1073741824 Sep 10 20:00:33 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3591cc58-078a-401f-8e88-b76c22f5eb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:33 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Volume volume-84a28890-d930-496b-b88f-d76fc729e480 (84a28890-d930-496b-b88f-d76fc729e480): created successfully Sep 10 20:00:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3591cc58-078a-401f-8e88-b76c22f5eb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Flow 'volume_create_manager' (2cb9e7e3-67d0-4c15-a9af-5013232f7d27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:00:33 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-811be7b8-78c5-42de-8354-2c2d5e498094 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Created volume successfully. Sep 10 20:00:34 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9063ea4e-79f9-4c57-9029-0b4bbc4c3b18 1073741824" returned: 0 in 0.556s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9063ea4e-79f9-4c57-9029-0b4bbc4c3b18 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:34 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9063ea4e-79f9-4c57-9029-0b4bbc4c3b18 Sep 10 20:00:34 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:34 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9063ea4e-79f9-4c57-9029-0b4bbc4c3b18" returned: 0 in 0.310s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:34 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:00:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.125s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:34 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1003419699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e939170c-800f-4ddd-8766-5b2cc5b26d26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c336bb46679464babe7f0a8ffa1a2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:00:32Z,use_quota=True,user_id='ca8b1968fa2942f9a32dff3f794f11e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:00:34 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Creating volume e939170c-800f-4ddd-8766-5b2cc5b26d26 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:00:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:34 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:00:34 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:00:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:34 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:00:34 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:00:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e939170c-800f-4ddd-8766-5b2cc5b26d26 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:34 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e939170c-800f-4ddd-8766-5b2cc5b26d26 1073741824 Sep 10 20:00:34 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c93a577-bfa3-45f2-bc77-0fa273808a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9063ea4e-79f9-4c57-9029-0b4bbc4c3b18', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80610e8a-146b-47c0-8725-b7df811147a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:34 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Volume volume-9063ea4e-79f9-4c57-9029-0b4bbc4c3b18 (9063ea4e-79f9-4c57-9029-0b4bbc4c3b18): created successfully Sep 10 20:00:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80610e8a-146b-47c0-8725-b7df811147a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Flow 'volume_create_manager' (cd4a63b8-5c42-4d5b-be32-7f7524faa3fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:00:34 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-39ab47d2-1608-4153-8efc-37d7f64e1a73 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Created volume successfully. Sep 10 20:00:35 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e939170c-800f-4ddd-8766-5b2cc5b26d26 1073741824" returned: 0 in 0.649s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e939170c-800f-4ddd-8766-5b2cc5b26d26 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:35 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e939170c-800f-4ddd-8766-5b2cc5b26d26 Sep 10 20:00:35 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:35 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e939170c-800f-4ddd-8766-5b2cc5b26d26" returned: 0 in 0.354s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:35 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:00:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b0ae0b-5c28-4769-b391-d820838cb8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e939170c-800f-4ddd-8766-5b2cc5b26d26', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530c59dc-dfea-48f9-b22f-bc7e32d03989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:35 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Volume volume-e939170c-800f-4ddd-8766-5b2cc5b26d26 (e939170c-800f-4ddd-8766-5b2cc5b26d26): created successfully Sep 10 20:00:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530c59dc-dfea-48f9-b22f-bc7e32d03989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Flow 'volume_create_manager' (1f61c3ab-68c3-4466-89c8-427b70781849) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:00:35 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-74741753-0286-489e-b527-f733dba3b107 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Created volume successfully. Sep 10 20:00:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-fcc8b48b-0f32-47f4-8324-d99f538e8f9d tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Acquiring lock "cinder-e939170c-800f-4ddd-8766-5b2cc5b26d26-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:00:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-fcc8b48b-0f32-47f4-8324-d99f538e8f9d tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "cinder-e939170c-800f-4ddd-8766-5b2cc5b26d26-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:00:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-fcc8b48b-0f32-47f4-8324-d99f538e8f9d tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Acquiring lock "cinder-quobyte-e939170c-800f-4ddd-8766-5b2cc5b26d26" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:00:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-fcc8b48b-0f32-47f4-8324-d99f538e8f9d tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "cinder-quobyte-e939170c-800f-4ddd-8766-5b2cc5b26d26" acquired by "delete_volume" :: waited 0.023s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:00:37 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5de4b82-27af-4e14-b859-8781979e66f8]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:00:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fcc8b48b-0f32-47f4-8324-d99f538e8f9d tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e939170c-800f-4ddd-8766-5b2cc5b26d26 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:37 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e939170c-800f-4ddd-8766-5b2cc5b26d26 Sep 10 20:00:37 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:37 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fcc8b48b-0f32-47f4-8324-d99f538e8f9d tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e939170c-800f-4ddd-8766-5b2cc5b26d26" returned: 0 in 0.409s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fcc8b48b-0f32-47f4-8324-d99f538e8f9d tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e939170c-800f-4ddd-8766-5b2cc5b26d26 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:37 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e939170c-800f-4ddd-8766-5b2cc5b26d26 Sep 10 20:00:37 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:37 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fcc8b48b-0f32-47f4-8324-d99f538e8f9d tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e939170c-800f-4ddd-8766-5b2cc5b26d26" returned: 0 in 0.305s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-fcc8b48b-0f32-47f4-8324-d99f538e8f9d tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "cinder-quobyte-e939170c-800f-4ddd-8766-5b2cc5b26d26" released by "delete_volume" :: held 0.767s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:00:37 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-fcc8b48b-0f32-47f4-8324-d99f538e8f9d tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Created reservations ['6aed37e1-cd1b-4b1a-baa5-f36a7394bf4f', 'b5b96d0e-a040-4c3d-9fd2-fb87da99e3cc', '1494804d-307d-438b-9c40-d13aeb6ef39c', 'dab41922-b269-497c-b893-4e5ff0d35a4c'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:00:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-fcc8b48b-0f32-47f4-8324-d99f538e8f9d tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-fcc8b48b-0f32-47f4-8324-d99f538e8f9d tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:38 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-fcc8b48b-0f32-47f4-8324-d99f538e8f9d tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:00:38 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-fcc8b48b-0f32-47f4-8324-d99f538e8f9d tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:00:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-fcc8b48b-0f32-47f4-8324-d99f538e8f9d tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fcc8b48b-0f32-47f4-8324-d99f538e8f9d tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:38 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:00:38 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-be40b591-555c-4f1e-80ce-9722ae5ad2d8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Acquiring lock "cinder-9063ea4e-79f9-4c57-9029-0b4bbc4c3b18-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:00:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-be40b591-555c-4f1e-80ce-9722ae5ad2d8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "cinder-9063ea4e-79f9-4c57-9029-0b4bbc4c3b18-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:00:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-be40b591-555c-4f1e-80ce-9722ae5ad2d8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Acquiring lock "cinder-quobyte-9063ea4e-79f9-4c57-9029-0b4bbc4c3b18" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:00:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-be40b591-555c-4f1e-80ce-9722ae5ad2d8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "cinder-quobyte-9063ea4e-79f9-4c57-9029-0b4bbc4c3b18" acquired by "delete_volume" :: waited 0.016s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:00:38 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d07cfe-0823-42b1-a606-697c405315d8]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:00:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-be40b591-555c-4f1e-80ce-9722ae5ad2d8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9063ea4e-79f9-4c57-9029-0b4bbc4c3b18 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:38 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fcc8b48b-0f32-47f4-8324-d99f538e8f9d tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.364s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:38 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-fcc8b48b-0f32-47f4-8324-d99f538e8f9d tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:00:38 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-fcc8b48b-0f32-47f4-8324-d99f538e8f9d tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Deleted volume successfully. Sep 10 20:00:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-fcc8b48b-0f32-47f4-8324-d99f538e8f9d tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "cinder-e939170c-800f-4ddd-8766-5b2cc5b26d26-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:00:38 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9063ea4e-79f9-4c57-9029-0b4bbc4c3b18 Sep 10 20:00:38 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:38 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-be40b591-555c-4f1e-80ce-9722ae5ad2d8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9063ea4e-79f9-4c57-9029-0b4bbc4c3b18" returned: 0 in 0.410s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-be40b591-555c-4f1e-80ce-9722ae5ad2d8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9063ea4e-79f9-4c57-9029-0b4bbc4c3b18 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:38 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9063ea4e-79f9-4c57-9029-0b4bbc4c3b18 Sep 10 20:00:38 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:39 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-be40b591-555c-4f1e-80ce-9722ae5ad2d8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9063ea4e-79f9-4c57-9029-0b4bbc4c3b18" returned: 0 in 0.276s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:39 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-be40b591-555c-4f1e-80ce-9722ae5ad2d8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "cinder-quobyte-9063ea4e-79f9-4c57-9029-0b4bbc4c3b18" released by "delete_volume" :: held 0.740s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:00:39 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-be40b591-555c-4f1e-80ce-9722ae5ad2d8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Created reservations ['1373e6d7-5d6d-4f76-b97f-f3736a79eb0e', 'd221f6a3-c8d8-4efe-9427-3bc34585f6e0', '1ae8c000-185c-4a68-a6f8-42b47a297537', 'ea239b94-5107-4cdf-a1e0-425c0e7aad29'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:00:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-be40b591-555c-4f1e-80ce-9722ae5ad2d8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-be40b591-555c-4f1e-80ce-9722ae5ad2d8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:39 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-be40b591-555c-4f1e-80ce-9722ae5ad2d8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:00:39 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-be40b591-555c-4f1e-80ce-9722ae5ad2d8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:00:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-be40b591-555c-4f1e-80ce-9722ae5ad2d8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-be40b591-555c-4f1e-80ce-9722ae5ad2d8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:39 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:00:39 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:39 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bcc97271-39ae-4e64-9d1c-a022ed43ffa8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Acquiring lock "cinder-84a28890-d930-496b-b88f-d76fc729e480-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:00:39 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bcc97271-39ae-4e64-9d1c-a022ed43ffa8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "cinder-84a28890-d930-496b-b88f-d76fc729e480-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:00:39 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bcc97271-39ae-4e64-9d1c-a022ed43ffa8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Acquiring lock "cinder-quobyte-84a28890-d930-496b-b88f-d76fc729e480" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:00:39 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bcc97271-39ae-4e64-9d1c-a022ed43ffa8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "cinder-quobyte-84a28890-d930-496b-b88f-d76fc729e480" acquired by "delete_volume" :: waited 0.029s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:00:39 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[403a6061-e616-4113-9070-ee6636bfd63b]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:00:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bcc97271-39ae-4e64-9d1c-a022ed43ffa8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-84a28890-d930-496b-b88f-d76fc729e480 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:39 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-be40b591-555c-4f1e-80ce-9722ae5ad2d8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.410s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:39 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-be40b591-555c-4f1e-80ce-9722ae5ad2d8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:00:39 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-be40b591-555c-4f1e-80ce-9722ae5ad2d8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Deleted volume successfully. Sep 10 20:00:39 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-be40b591-555c-4f1e-80ce-9722ae5ad2d8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "cinder-9063ea4e-79f9-4c57-9029-0b4bbc4c3b18-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:00:39 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-84a28890-d930-496b-b88f-d76fc729e480 Sep 10 20:00:39 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] Flow 'volume_create_manager' (d47a160a-d60e-48f0-8339-d96b729cf4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d66bcb-427c-40c6-9b92-65a72c830618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d66bcb-427c-40c6-9b92-65a72c830618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-566830394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87ba43bc-ae93-45b8-85e3-8b241df4c967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26074dff0ef44a689dc68c126e150efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:00:40Z,use_quota=True,user_id='a3245326a6554a61918a354e46aae5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f89c2f22-2885-4198-b40d-1d898888101e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f89c2f22-2885-4198-b40d-1d898888101e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f68763-1259-4957-8a59-35b0c9705b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f68763-1259-4957-8a59-35b0c9705b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87ba43bc-ae93-45b8-85e3-8b241df4c967', 'volume_name': 'volume-87ba43bc-ae93-45b8-85e3-8b241df4c967', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0107c18b-57c0-42ad-8883-969519365402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0107c18b-57c0-42ad-8883-969519365402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c1439e6-ad1f-4e56-b1d4-d630b177636e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:40 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] Volume 87ba43bc-ae93-45b8-85e3-8b241df4c967: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87ba43bc-ae93-45b8-85e3-8b241df4c967', 'volume_size': 1} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-566830394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87ba43bc-ae93-45b8-85e3-8b241df4c967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26074dff0ef44a689dc68c126e150efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:00:40Z,use_quota=True,user_id='a3245326a6554a61918a354e46aae5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] Creating volume 87ba43bc-ae93-45b8-85e3-8b241df4c967 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:00:40 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-87ba43bc-ae93-45b8-85e3-8b241df4c967 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:40 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-87ba43bc-ae93-45b8-85e3-8b241df4c967 1073741824 Sep 10 20:00:40 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:40 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bcc97271-39ae-4e64-9d1c-a022ed43ffa8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-84a28890-d930-496b-b88f-d76fc729e480" returned: 0 in 0.528s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bcc97271-39ae-4e64-9d1c-a022ed43ffa8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-84a28890-d930-496b-b88f-d76fc729e480 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:40 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-84a28890-d930-496b-b88f-d76fc729e480 Sep 10 20:00:40 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:00:40 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] Flow 'volume_create_manager' (65ea97b1-9b96-4d09-a2ee-ef7edfbce30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe475a6-1575-4dbe-b817-925c342813bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bcc97271-39ae-4e64-9d1c-a022ed43ffa8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-84a28890-d930-496b-b88f-d76fc729e480" returned: 0 in 0.383s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe475a6-1575-4dbe-b817-925c342813bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-241499728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc103b71-37d9-4db8-bd47-8562f049376f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26074dff0ef44a689dc68c126e150efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:00:40Z,use_quota=True,user_id='a3245326a6554a61918a354e46aae5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d32ba99-519d-468f-a4c9-5b680813edd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d32ba99-519d-468f-a4c9-5b680813edd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66bd75fb-da08-4c50-8a52-b06eaeee521a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66bd75fb-da08-4c50-8a52-b06eaeee521a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc103b71-37d9-4db8-bd47-8562f049376f', 'volume_name': 'volume-dc103b71-37d9-4db8-bd47-8562f049376f', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b085aaf8-e70b-4578-ba6c-38192f08a798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b085aaf8-e70b-4578-ba6c-38192f08a798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7c3ac91-7873-45ea-8cb4-1abe4c807846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:40 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] Volume dc103b71-37d9-4db8-bd47-8562f049376f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc103b71-37d9-4db8-bd47-8562f049376f', 'volume_size': 1} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bcc97271-39ae-4e64-9d1c-a022ed43ffa8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "cinder-quobyte-84a28890-d930-496b-b88f-d76fc729e480" released by "delete_volume" :: held 1.036s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-bcc97271-39ae-4e64-9d1c-a022ed43ffa8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Created reservations ['3ccf9b6e-a962-487e-9f9b-7c7f5fd5f412', '7fa84d04-0122-4c54-b6a4-124c47b8cbf3', '42affb59-1ad3-4aed-affe-3401e7d6a568', '3b66b43d-e3a0-46ca-9f9a-db7385f5b93b'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-bcc97271-39ae-4e64-9d1c-a022ed43ffa8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-bcc97271-39ae-4e64-9d1c-a022ed43ffa8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-bcc97271-39ae-4e64-9d1c-a022ed43ffa8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-bcc97271-39ae-4e64-9d1c-a022ed43ffa8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-bcc97271-39ae-4e64-9d1c-a022ed43ffa8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bcc97271-39ae-4e64-9d1c-a022ed43ffa8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:40 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:00:40 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:40 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-87ba43bc-ae93-45b8-85e3-8b241df4c967 1073741824" returned: 0 in 0.743s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-87ba43bc-ae93-45b8-85e3-8b241df4c967 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:41 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-87ba43bc-ae93-45b8-85e3-8b241df4c967 Sep 10 20:00:41 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] Flow 'volume_create_manager' (836764c7-17c2-4526-bf50-6441c75195d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1231baca-10a4-449d-a70a-6d1ceaafd318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1231baca-10a4-449d-a70a-6d1ceaafd318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-434853015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61dc8d83-e635-43ed-af9c-5c66cbd9f23e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26074dff0ef44a689dc68c126e150efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:00:41Z,use_quota=True,user_id='a3245326a6554a61918a354e46aae5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fcd777e-dfd8-493a-8ea7-e2630aa4802c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fcd777e-dfd8-493a-8ea7-e2630aa4802c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97396b2f-9a3b-4d9d-b9f8-209598672cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97396b2f-9a3b-4d9d-b9f8-209598672cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61dc8d83-e635-43ed-af9c-5c66cbd9f23e', 'volume_name': 'volume-61dc8d83-e635-43ed-af9c-5c66cbd9f23e', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a73c846-8cba-4f63-9be3-e1f0b23f1751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a73c846-8cba-4f63-9be3-e1f0b23f1751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e847297-7f46-40d3-825d-4b145466bcd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:41 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] Volume 61dc8d83-e635-43ed-af9c-5c66cbd9f23e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61dc8d83-e635-43ed-af9c-5c66cbd9f23e', 'volume_size': 1} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:41 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bcc97271-39ae-4e64-9d1c-a022ed43ffa8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.342s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-bcc97271-39ae-4e64-9d1c-a022ed43ffa8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:00:41 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-bcc97271-39ae-4e64-9d1c-a022ed43ffa8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Deleted volume successfully. Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-bcc97271-39ae-4e64-9d1c-a022ed43ffa8 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "cinder-84a28890-d930-496b-b88f-d76fc729e480-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:00:41 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-87ba43bc-ae93-45b8-85e3-8b241df4c967" returned: 0 in 0.387s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.687s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-241499728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc103b71-37d9-4db8-bd47-8562f049376f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26074dff0ef44a689dc68c126e150efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:00:40Z,use_quota=True,user_id='a3245326a6554a61918a354e46aae5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] Creating volume dc103b71-37d9-4db8-bd47-8562f049376f {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:00:41 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-dc103b71-37d9-4db8-bd47-8562f049376f 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c1439e6-ad1f-4e56-b1d4-d630b177636e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87ba43bc-ae93-45b8-85e3-8b241df4c967', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (768a8b39-ca48-4873-b8db-4999f2f2bfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:41 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-dc103b71-37d9-4db8-bd47-8562f049376f 1073741824 Sep 10 20:00:41 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:41 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] Volume volume-87ba43bc-ae93-45b8-85e3-8b241df4c967 (87ba43bc-ae93-45b8-85e3-8b241df4c967): created successfully Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (768a8b39-ca48-4873-b8db-4999f2f2bfe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] Flow 'volume_create_manager' (d47a160a-d60e-48f0-8339-d96b729cf4eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:00:41 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-479b8aff-0135-420d-8f4d-1b484e32d627 tempest-CreateVolumesFromImageTest-1531560306 None] Created volume successfully. Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] Flow 'volume_create_manager' (14a8abf7-c9bc-4a47-aaab-b53eb61eb526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7ddc73c-8b6d-4dd2-bb46-0b34075e3bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7ddc73c-8b6d-4dd2-bb46-0b34075e3bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1232433993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecf32758-6dae-40ab-a126-9baaff638315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26074dff0ef44a689dc68c126e150efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:00:42Z,use_quota=True,user_id='a3245326a6554a61918a354e46aae5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb6745f-b922-4089-a439-247d0dc42fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb6745f-b922-4089-a439-247d0dc42fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7468954a-aefa-476b-b283-b0242361e821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7468954a-aefa-476b-b283-b0242361e821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecf32758-6dae-40ab-a126-9baaff638315', 'volume_name': 'volume-ecf32758-6dae-40ab-a126-9baaff638315', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9379b14-4e59-4e36-a3ea-fa6befdc696c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9379b14-4e59-4e36-a3ea-fa6befdc696c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef18ba3-7b80-4a62-afba-65d162896fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:41 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] Volume ecf32758-6dae-40ab-a126-9baaff638315: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecf32758-6dae-40ab-a126-9baaff638315', 'volume_size': 1} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-539ba1ca-157b-4a53-bee3-f55600a219ef tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Acquiring lock "cinder-5e35f5ae-d253-4398-9267-271c2613fd82-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-539ba1ca-157b-4a53-bee3-f55600a219ef tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "cinder-5e35f5ae-d253-4398-9267-271c2613fd82-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-539ba1ca-157b-4a53-bee3-f55600a219ef tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Acquiring lock "cinder-quobyte-5e35f5ae-d253-4398-9267-271c2613fd82" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:00:41 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-539ba1ca-157b-4a53-bee3-f55600a219ef tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "cinder-quobyte-5e35f5ae-d253-4398-9267-271c2613fd82" acquired by "delete_volume" :: waited 0.015s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[e105f013-030d-469f-951c-d15dff72403f]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-539ba1ca-157b-4a53-bee3-f55600a219ef tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5e35f5ae-d253-4398-9267-271c2613fd82 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] Flow 'volume_create_manager' (e1413e7f-c03d-4ef5-9dac-8ded7c3a75ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5dd271-7c60-4ba8-a0d5-d7f84c208369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:42 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-dc103b71-37d9-4db8-bd47-8562f049376f 1073741824" returned: 0 in 0.695s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5dd271-7c60-4ba8-a0d5-d7f84c208369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1302013514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d6a57e6-55ca-407c-bd54-7ce0d43dc11a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26074dff0ef44a689dc68c126e150efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:00:42Z,use_quota=True,user_id='a3245326a6554a61918a354e46aae5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38ce2417-f0e7-4d2a-894e-bfc409a15c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38ce2417-f0e7-4d2a-894e-bfc409a15c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94c5fcb-830a-41e0-b749-df87335dfa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94c5fcb-830a-41e0-b749-df87335dfa48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d6a57e6-55ca-407c-bd54-7ce0d43dc11a', 'volume_name': 'volume-2d6a57e6-55ca-407c-bd54-7ce0d43dc11a', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:42 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5e35f5ae-d253-4398-9267-271c2613fd82 Sep 10 20:00:42 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4f5a2a-df21-436f-868c-4c7155a7f1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4f5a2a-df21-436f-868c-4c7155a7f1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b113dbf-b438-47dc-8bd0-0816c627c76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:42 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] Volume 2d6a57e6-55ca-407c-bd54-7ce0d43dc11a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d6a57e6-55ca-407c-bd54-7ce0d43dc11a', 'volume_size': 1} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-dc103b71-37d9-4db8-bd47-8562f049376f {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:42 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-dc103b71-37d9-4db8-bd47-8562f049376f Sep 10 20:00:42 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:42 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-539ba1ca-157b-4a53-bee3-f55600a219ef tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5e35f5ae-d253-4398-9267-271c2613fd82" returned: 0 in 0.372s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-539ba1ca-157b-4a53-bee3-f55600a219ef tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5e35f5ae-d253-4398-9267-271c2613fd82 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:42 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5e35f5ae-d253-4398-9267-271c2613fd82 Sep 10 20:00:42 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:42 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-dc103b71-37d9-4db8-bd47-8562f049376f" returned: 0 in 0.251s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.226s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-434853015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61dc8d83-e635-43ed-af9c-5c66cbd9f23e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26074dff0ef44a689dc68c126e150efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:00:41Z,use_quota=True,user_id='a3245326a6554a61918a354e46aae5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] Creating volume 61dc8d83-e635-43ed-af9c-5c66cbd9f23e {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:00:42 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-61dc8d83-e635-43ed-af9c-5c66cbd9f23e 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7c3ac91-7873-45ea-8cb4-1abe4c807846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc103b71-37d9-4db8-bd47-8562f049376f', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:42 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-61dc8d83-e635-43ed-af9c-5c66cbd9f23e 1073741824 Sep 10 20:00:42 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd37ad5e-4396-44cc-8f73-21a517a3f832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:42 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] Volume volume-dc103b71-37d9-4db8-bd47-8562f049376f (dc103b71-37d9-4db8-bd47-8562f049376f): created successfully Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd37ad5e-4396-44cc-8f73-21a517a3f832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] Flow 'volume_create_manager' (65ea97b1-9b96-4d09-a2ee-ef7edfbce30f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:00:42 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-bd7eb548-1c36-407b-8435-3025ac3b1e59 tempest-CreateVolumesFromImageTest-1531560306 None] Created volume successfully. Sep 10 20:00:42 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-539ba1ca-157b-4a53-bee3-f55600a219ef tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5e35f5ae-d253-4398-9267-271c2613fd82" returned: 0 in 0.249s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-539ba1ca-157b-4a53-bee3-f55600a219ef tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "cinder-quobyte-5e35f5ae-d253-4398-9267-271c2613fd82" released by "delete_volume" :: held 0.676s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-539ba1ca-157b-4a53-bee3-f55600a219ef tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Created reservations ['d68397b4-25ce-467c-9459-5ee81c73dcd6', 'ebb411b6-5d83-42a1-b15d-625fbc962274', '3075aa74-ff55-4770-920b-e162ea1ded1c', '58de1e24-bc96-4528-8cd8-4178749c26da'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-539ba1ca-157b-4a53-bee3-f55600a219ef tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-539ba1ca-157b-4a53-bee3-f55600a219ef tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-539ba1ca-157b-4a53-bee3-f55600a219ef tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-539ba1ca-157b-4a53-bee3-f55600a219ef tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-539ba1ca-157b-4a53-bee3-f55600a219ef tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-539ba1ca-157b-4a53-bee3-f55600a219ef tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:42 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:00:42 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:42 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-61dc8d83-e635-43ed-af9c-5c66cbd9f23e 1073741824" returned: 0 in 0.448s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-61dc8d83-e635-43ed-af9c-5c66cbd9f23e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:42 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-61dc8d83-e635-43ed-af9c-5c66cbd9f23e Sep 10 20:00:42 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:43 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-539ba1ca-157b-4a53-bee3-f55600a219ef tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.275s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-539ba1ca-157b-4a53-bee3-f55600a219ef tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e791f009-625b-4607-89bd-5c9a04dac98c tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Acquiring lock "cinder-ac9afe40-ab5c-4325-b9f0-95236d08241a-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:00:43 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-539ba1ca-157b-4a53-bee3-f55600a219ef tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Deleted volume successfully. Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-539ba1ca-157b-4a53-bee3-f55600a219ef tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "cinder-5e35f5ae-d253-4398-9267-271c2613fd82-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e791f009-625b-4607-89bd-5c9a04dac98c tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "cinder-ac9afe40-ab5c-4325-b9f0-95236d08241a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e791f009-625b-4607-89bd-5c9a04dac98c tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Acquiring lock "cinder-quobyte-ac9afe40-ab5c-4325-b9f0-95236d08241a" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e791f009-625b-4607-89bd-5c9a04dac98c tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "cinder-quobyte-ac9afe40-ab5c-4325-b9f0-95236d08241a" acquired by "delete_volume" :: waited 0.028s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d9c366-fcce-4e76-b518-51a457ca1d67]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e791f009-625b-4607-89bd-5c9a04dac98c tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac9afe40-ab5c-4325-b9f0-95236d08241a {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:43 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-61dc8d83-e635-43ed-af9c-5c66cbd9f23e" returned: 0 in 0.323s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.530s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1232433993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecf32758-6dae-40ab-a126-9baaff638315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26074dff0ef44a689dc68c126e150efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:00:42Z,use_quota=True,user_id='a3245326a6554a61918a354e46aae5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] Creating volume ecf32758-6dae-40ab-a126-9baaff638315 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:00:43 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ecf32758-6dae-40ab-a126-9baaff638315 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e847297-7f46-40d3-825d-4b145466bcd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61dc8d83-e635-43ed-af9c-5c66cbd9f23e', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:43 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ecf32758-6dae-40ab-a126-9baaff638315 1073741824 Sep 10 20:00:43 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cff8b1b-7bc5-42c8-87bf-be09ed330297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:43 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac9afe40-ab5c-4325-b9f0-95236d08241a Sep 10 20:00:43 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:43 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] Volume volume-61dc8d83-e635-43ed-af9c-5c66cbd9f23e (61dc8d83-e635-43ed-af9c-5c66cbd9f23e): created successfully Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cff8b1b-7bc5-42c8-87bf-be09ed330297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] Flow 'volume_create_manager' (836764c7-17c2-4526-bf50-6441c75195d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:00:43 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-61b3590a-d82c-492c-a49f-3c6e2b1146e3 tempest-CreateVolumesFromImageTest-1531560306 None] Created volume successfully. Sep 10 20:00:43 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e791f009-625b-4607-89bd-5c9a04dac98c tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac9afe40-ab5c-4325-b9f0-95236d08241a" returned: 0 in 0.388s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e791f009-625b-4607-89bd-5c9a04dac98c tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac9afe40-ab5c-4325-b9f0-95236d08241a {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:43 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac9afe40-ab5c-4325-b9f0-95236d08241a Sep 10 20:00:43 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:43 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ecf32758-6dae-40ab-a126-9baaff638315 1073741824" returned: 0 in 0.446s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ecf32758-6dae-40ab-a126-9baaff638315 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:43 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ecf32758-6dae-40ab-a126-9baaff638315 Sep 10 20:00:43 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:43 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e791f009-625b-4607-89bd-5c9a04dac98c tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ac9afe40-ab5c-4325-b9f0-95236d08241a" returned: 0 in 0.260s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e791f009-625b-4607-89bd-5c9a04dac98c tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "cinder-quobyte-ac9afe40-ab5c-4325-b9f0-95236d08241a" released by "delete_volume" :: held 0.687s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-e791f009-625b-4607-89bd-5c9a04dac98c tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Created reservations ['db2d7cbb-eb61-420a-b409-2541fed4e584', '14cfdb27-edf8-4194-9fbc-4a498f8055bd', 'c489f14e-8ea8-470c-8578-4e5f66f0ea81', '470b5f6d-d402-4882-9da9-edd6effb0840'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e791f009-625b-4607-89bd-5c9a04dac98c tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e791f009-625b-4607-89bd-5c9a04dac98c tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e791f009-625b-4607-89bd-5c9a04dac98c tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e791f009-625b-4607-89bd-5c9a04dac98c tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e791f009-625b-4607-89bd-5c9a04dac98c tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e791f009-625b-4607-89bd-5c9a04dac98c tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:44 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:44 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:00:44 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ecf32758-6dae-40ab-a126-9baaff638315" returned: 0 in 0.261s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.868s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1302013514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d6a57e6-55ca-407c-bd54-7ce0d43dc11a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26074dff0ef44a689dc68c126e150efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:00:42Z,use_quota=True,user_id='a3245326a6554a61918a354e46aae5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] Creating volume 2d6a57e6-55ca-407c-bd54-7ce0d43dc11a {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:00:44 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2d6a57e6-55ca-407c-bd54-7ce0d43dc11a 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef18ba3-7b80-4a62-afba-65d162896fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecf32758-6dae-40ab-a126-9baaff638315', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:44 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2d6a57e6-55ca-407c-bd54-7ce0d43dc11a 1073741824 Sep 10 20:00:44 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f567d9-fecf-45e8-bbb1-a112b674496f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:44 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] Volume volume-ecf32758-6dae-40ab-a126-9baaff638315 (ecf32758-6dae-40ab-a126-9baaff638315): created successfully Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f567d9-fecf-45e8-bbb1-a112b674496f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] Flow 'volume_create_manager' (14a8abf7-c9bc-4a47-aaab-b53eb61eb526) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:00:44 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-22ad87c5-4241-439e-8495-28cdf2a9dae8 tempest-CreateVolumesFromImageTest-1531560306 None] Created volume successfully. Sep 10 20:00:44 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e791f009-625b-4607-89bd-5c9a04dac98c tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.284s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-e791f009-625b-4607-89bd-5c9a04dac98c tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:00:44 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-e791f009-625b-4607-89bd-5c9a04dac98c tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Deleted volume successfully. Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e791f009-625b-4607-89bd-5c9a04dac98c tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "cinder-ac9afe40-ab5c-4325-b9f0-95236d08241a-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-40d1f8db-a834-409c-b10e-144d6f3f3b57 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Acquiring lock "cinder-4957387a-8de4-4eeb-9f32-a774465ccb03-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-40d1f8db-a834-409c-b10e-144d6f3f3b57 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "cinder-4957387a-8de4-4eeb-9f32-a774465ccb03-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-40d1f8db-a834-409c-b10e-144d6f3f3b57 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Acquiring lock "cinder-quobyte-4957387a-8de4-4eeb-9f32-a774465ccb03" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-40d1f8db-a834-409c-b10e-144d6f3f3b57 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "cinder-quobyte-4957387a-8de4-4eeb-9f32-a774465ccb03" acquired by "delete_volume" :: waited 0.024s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[f420dca9-c743-43ab-b667-07f9d30ee65f]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-40d1f8db-a834-409c-b10e-144d6f3f3b57 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4957387a-8de4-4eeb-9f32-a774465ccb03 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:44 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4957387a-8de4-4eeb-9f32-a774465ccb03 Sep 10 20:00:44 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:44 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2d6a57e6-55ca-407c-bd54-7ce0d43dc11a 1073741824" returned: 0 in 0.575s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2d6a57e6-55ca-407c-bd54-7ce0d43dc11a {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:44 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2d6a57e6-55ca-407c-bd54-7ce0d43dc11a Sep 10 20:00:44 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:44 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-40d1f8db-a834-409c-b10e-144d6f3f3b57 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4957387a-8de4-4eeb-9f32-a774465ccb03" returned: 0 in 0.353s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-40d1f8db-a834-409c-b10e-144d6f3f3b57 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4957387a-8de4-4eeb-9f32-a774465ccb03 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:44 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4957387a-8de4-4eeb-9f32-a774465ccb03 Sep 10 20:00:44 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:44 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2d6a57e6-55ca-407c-bd54-7ce0d43dc11a" returned: 0 in 0.281s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b113dbf-b438-47dc-8bd0-0816c627c76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d6a57e6-55ca-407c-bd54-7ce0d43dc11a', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6495f736-5b9f-4f1f-b54f-19803ad33de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:44 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] Volume volume-2d6a57e6-55ca-407c-bd54-7ce0d43dc11a (2d6a57e6-55ca-407c-bd54-7ce0d43dc11a): created successfully Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6495f736-5b9f-4f1f-b54f-19803ad33de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:44 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] Flow 'volume_create_manager' (e1413e7f-c03d-4ef5-9dac-8ded7c3a75ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:00:44 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-5d0da06c-0d9a-4de2-a22d-4e433f0f5911 tempest-CreateVolumesFromImageTest-1531560306 None] Created volume successfully. Sep 10 20:00:45 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-40d1f8db-a834-409c-b10e-144d6f3f3b57 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4957387a-8de4-4eeb-9f32-a774465ccb03" returned: 0 in 0.263s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:45 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-40d1f8db-a834-409c-b10e-144d6f3f3b57 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "cinder-quobyte-4957387a-8de4-4eeb-9f32-a774465ccb03" released by "delete_volume" :: held 0.655s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:00:45 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-40d1f8db-a834-409c-b10e-144d6f3f3b57 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Created reservations ['51a3bdd1-8301-479b-b9c5-9ef9bedcf23f', 'b12f071b-5240-4ac6-b416-a76fb0a10dac', 'f41cda14-ccfe-411d-b8aa-d35557fc8c23', 'e29be30f-769f-4dee-9274-866fbc2aee90'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:00:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-40d1f8db-a834-409c-b10e-144d6f3f3b57 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-40d1f8db-a834-409c-b10e-144d6f3f3b57 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-40d1f8db-a834-409c-b10e-144d6f3f3b57 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:00:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-40d1f8db-a834-409c-b10e-144d6f3f3b57 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:00:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-40d1f8db-a834-409c-b10e-144d6f3f3b57 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-40d1f8db-a834-409c-b10e-144d6f3f3b57 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:45 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:00:45 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:45 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-40d1f8db-a834-409c-b10e-144d6f3f3b57 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.247s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:45 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-40d1f8db-a834-409c-b10e-144d6f3f3b57 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:00:45 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-40d1f8db-a834-409c-b10e-144d6f3f3b57 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Deleted volume successfully. Sep 10 20:00:45 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-40d1f8db-a834-409c-b10e-144d6f3f3b57 tempest-CreateVolumesFromSourceVolumeTest-1068878289 None] Lock "cinder-4957387a-8de4-4eeb-9f32-a774465ccb03-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:00:45 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-78397d04-f601-421f-8e2e-361bf6062a5e tempest-CreateVolumesFromImageTest-1531560306 None] Acquiring lock "cinder-2d6a57e6-55ca-407c-bd54-7ce0d43dc11a-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:00:45 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-78397d04-f601-421f-8e2e-361bf6062a5e tempest-CreateVolumesFromImageTest-1531560306 None] Lock "cinder-2d6a57e6-55ca-407c-bd54-7ce0d43dc11a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:00:45 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-78397d04-f601-421f-8e2e-361bf6062a5e tempest-CreateVolumesFromImageTest-1531560306 None] Acquiring lock "cinder-quobyte-2d6a57e6-55ca-407c-bd54-7ce0d43dc11a" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:00:45 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-78397d04-f601-421f-8e2e-361bf6062a5e tempest-CreateVolumesFromImageTest-1531560306 None] Lock "cinder-quobyte-2d6a57e6-55ca-407c-bd54-7ce0d43dc11a" acquired by "delete_volume" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:00:45 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[982c6806-dbb6-4db2-8980-f6f182f9f447]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:00:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-78397d04-f601-421f-8e2e-361bf6062a5e tempest-CreateVolumesFromImageTest-1531560306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2d6a57e6-55ca-407c-bd54-7ce0d43dc11a {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:45 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2d6a57e6-55ca-407c-bd54-7ce0d43dc11a Sep 10 20:00:45 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:46 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-78397d04-f601-421f-8e2e-361bf6062a5e tempest-CreateVolumesFromImageTest-1531560306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2d6a57e6-55ca-407c-bd54-7ce0d43dc11a" returned: 0 in 0.392s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-78397d04-f601-421f-8e2e-361bf6062a5e tempest-CreateVolumesFromImageTest-1531560306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2d6a57e6-55ca-407c-bd54-7ce0d43dc11a {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:46 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2d6a57e6-55ca-407c-bd54-7ce0d43dc11a Sep 10 20:00:46 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:46 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-78397d04-f601-421f-8e2e-361bf6062a5e tempest-CreateVolumesFromImageTest-1531560306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2d6a57e6-55ca-407c-bd54-7ce0d43dc11a" returned: 0 in 0.263s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:46 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-78397d04-f601-421f-8e2e-361bf6062a5e tempest-CreateVolumesFromImageTest-1531560306 None] Lock "cinder-quobyte-2d6a57e6-55ca-407c-bd54-7ce0d43dc11a" released by "delete_volume" :: held 0.710s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:00:46 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:UPDATE=109,cinder:SELECT=78,cinder:INSERT=24,cinder:DELETE=11 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:00:46 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-78397d04-f601-421f-8e2e-361bf6062a5e tempest-CreateVolumesFromImageTest-1531560306 None] Created reservations ['c0a8717d-0330-4e2a-b47f-f9cf1db4336c', '157ce8b9-fe81-4f8b-a607-db2ba4562df5', 'cb9aad1b-9d70-42f8-b9f4-792605c1d103', '8cf8901b-5735-45f6-93ea-81966071a806'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:00:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-78397d04-f601-421f-8e2e-361bf6062a5e tempest-CreateVolumesFromImageTest-1531560306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-78397d04-f601-421f-8e2e-361bf6062a5e tempest-CreateVolumesFromImageTest-1531560306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:46 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-78397d04-f601-421f-8e2e-361bf6062a5e tempest-CreateVolumesFromImageTest-1531560306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:00:46 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-78397d04-f601-421f-8e2e-361bf6062a5e tempest-CreateVolumesFromImageTest-1531560306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:00:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-78397d04-f601-421f-8e2e-361bf6062a5e tempest-CreateVolumesFromImageTest-1531560306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-78397d04-f601-421f-8e2e-361bf6062a5e tempest-CreateVolumesFromImageTest-1531560306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:46 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:00:46 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:46 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-65f011ef-f2e0-465b-92e9-8d3755a4004b tempest-CreateVolumesFromImageTest-1531560306 None] Acquiring lock "cinder-ecf32758-6dae-40ab-a126-9baaff638315-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:00:46 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-78397d04-f601-421f-8e2e-361bf6062a5e tempest-CreateVolumesFromImageTest-1531560306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.303s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:46 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-78397d04-f601-421f-8e2e-361bf6062a5e tempest-CreateVolumesFromImageTest-1531560306 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:00:46 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-78397d04-f601-421f-8e2e-361bf6062a5e tempest-CreateVolumesFromImageTest-1531560306 None] Deleted volume successfully. Sep 10 20:00:46 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-65f011ef-f2e0-465b-92e9-8d3755a4004b tempest-CreateVolumesFromImageTest-1531560306 None] Lock "cinder-ecf32758-6dae-40ab-a126-9baaff638315-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:00:46 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-78397d04-f601-421f-8e2e-361bf6062a5e tempest-CreateVolumesFromImageTest-1531560306 None] Lock "cinder-2d6a57e6-55ca-407c-bd54-7ce0d43dc11a-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:00:46 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-65f011ef-f2e0-465b-92e9-8d3755a4004b tempest-CreateVolumesFromImageTest-1531560306 None] Acquiring lock "cinder-quobyte-ecf32758-6dae-40ab-a126-9baaff638315" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:00:46 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-65f011ef-f2e0-465b-92e9-8d3755a4004b tempest-CreateVolumesFromImageTest-1531560306 None] Lock "cinder-quobyte-ecf32758-6dae-40ab-a126-9baaff638315" acquired by "delete_volume" :: waited 0.016s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:00:46 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[9511c3af-5ecb-4203-9289-3ff1f2ad35c8]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:00:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-65f011ef-f2e0-465b-92e9-8d3755a4004b tempest-CreateVolumesFromImageTest-1531560306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ecf32758-6dae-40ab-a126-9baaff638315 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:47 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ecf32758-6dae-40ab-a126-9baaff638315 Sep 10 20:00:47 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:47 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-65f011ef-f2e0-465b-92e9-8d3755a4004b tempest-CreateVolumesFromImageTest-1531560306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ecf32758-6dae-40ab-a126-9baaff638315" returned: 0 in 0.437s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-65f011ef-f2e0-465b-92e9-8d3755a4004b tempest-CreateVolumesFromImageTest-1531560306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ecf32758-6dae-40ab-a126-9baaff638315 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:47 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ecf32758-6dae-40ab-a126-9baaff638315 Sep 10 20:00:47 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:47 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-65f011ef-f2e0-465b-92e9-8d3755a4004b tempest-CreateVolumesFromImageTest-1531560306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ecf32758-6dae-40ab-a126-9baaff638315" returned: 0 in 0.287s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:47 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-65f011ef-f2e0-465b-92e9-8d3755a4004b tempest-CreateVolumesFromImageTest-1531560306 None] Lock "cinder-quobyte-ecf32758-6dae-40ab-a126-9baaff638315" released by "delete_volume" :: held 0.772s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:00:47 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-65f011ef-f2e0-465b-92e9-8d3755a4004b tempest-CreateVolumesFromImageTest-1531560306 None] Created reservations ['88a304fd-f460-45a2-bc6a-0a0fda6a8bd8', '1a7ae0b4-36f7-4f87-a86e-3d4b533c2620', 'a4038188-a85f-4d92-b53d-ad9c7ddeedd3', '0cf4d157-dd83-466e-9758-f546f856146e'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:00:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-65f011ef-f2e0-465b-92e9-8d3755a4004b tempest-CreateVolumesFromImageTest-1531560306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-65f011ef-f2e0-465b-92e9-8d3755a4004b tempest-CreateVolumesFromImageTest-1531560306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:47 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-65f011ef-f2e0-465b-92e9-8d3755a4004b tempest-CreateVolumesFromImageTest-1531560306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:00:47 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-65f011ef-f2e0-465b-92e9-8d3755a4004b tempest-CreateVolumesFromImageTest-1531560306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:00:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-65f011ef-f2e0-465b-92e9-8d3755a4004b tempest-CreateVolumesFromImageTest-1531560306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-65f011ef-f2e0-465b-92e9-8d3755a4004b tempest-CreateVolumesFromImageTest-1531560306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:47 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:00:47 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-353b7b8c-836c-4a83-a131-8c35578891e4 tempest-CreateVolumesFromImageTest-1531560306 None] Acquiring lock "cinder-61dc8d83-e635-43ed-af9c-5c66cbd9f23e-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-353b7b8c-836c-4a83-a131-8c35578891e4 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "cinder-61dc8d83-e635-43ed-af9c-5c66cbd9f23e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-353b7b8c-836c-4a83-a131-8c35578891e4 tempest-CreateVolumesFromImageTest-1531560306 None] Acquiring lock "cinder-quobyte-61dc8d83-e635-43ed-af9c-5c66cbd9f23e" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-353b7b8c-836c-4a83-a131-8c35578891e4 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "cinder-quobyte-61dc8d83-e635-43ed-af9c-5c66cbd9f23e" acquired by "delete_volume" :: waited 0.027s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9959a84-35ec-4d5c-abd8-8a3fbbd7ff3d]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-353b7b8c-836c-4a83-a131-8c35578891e4 tempest-CreateVolumesFromImageTest-1531560306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-61dc8d83-e635-43ed-af9c-5c66cbd9f23e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:48 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-65f011ef-f2e0-465b-92e9-8d3755a4004b tempest-CreateVolumesFromImageTest-1531560306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.398s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-65f011ef-f2e0-465b-92e9-8d3755a4004b tempest-CreateVolumesFromImageTest-1531560306 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:00:48 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-65f011ef-f2e0-465b-92e9-8d3755a4004b tempest-CreateVolumesFromImageTest-1531560306 None] Deleted volume successfully. Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-65f011ef-f2e0-465b-92e9-8d3755a4004b tempest-CreateVolumesFromImageTest-1531560306 None] Lock "cinder-ecf32758-6dae-40ab-a126-9baaff638315-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:00:48 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-61dc8d83-e635-43ed-af9c-5c66cbd9f23e Sep 10 20:00:48 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:48 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-353b7b8c-836c-4a83-a131-8c35578891e4 tempest-CreateVolumesFromImageTest-1531560306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-61dc8d83-e635-43ed-af9c-5c66cbd9f23e" returned: 0 in 0.516s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-353b7b8c-836c-4a83-a131-8c35578891e4 tempest-CreateVolumesFromImageTest-1531560306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-61dc8d83-e635-43ed-af9c-5c66cbd9f23e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:48 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-61dc8d83-e635-43ed-af9c-5c66cbd9f23e Sep 10 20:00:48 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] Flow 'volume_create_manager' (4e5c9e47-513e-4207-bcfb-aeb7c1042883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6660d72c-626f-4617-afad-41d01b660045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6660d72c-626f-4617-afad-41d01b660045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae1b9a58-4571-429b-8d87-39c311114b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ff983f714204371aeeb752a36d9a584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:00:49Z,use_quota=True,user_id='4c175853d8fc4bbf9cc0859812357955',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ef972a2-3aa3-451d-b342-bbb27f770445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ef972a2-3aa3-451d-b342-bbb27f770445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79191733-ff8d-4f02-a175-dc1e2e8e9895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79191733-ff8d-4f02-a175-dc1e2e8e9895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae1b9a58-4571-429b-8d87-39c311114b46', 'volume_name': 'volume-ae1b9a58-4571-429b-8d87-39c311114b46', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72516c38-9968-4f1c-95cc-6db5a69b006b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72516c38-9968-4f1c-95cc-6db5a69b006b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac8d3170-a7e6-48aa-ace7-39bf39bfcf06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:48 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] Volume ae1b9a58-4571-429b-8d87-39c311114b46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae1b9a58-4571-429b-8d87-39c311114b46', 'volume_size': 1} Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae1b9a58-4571-429b-8d87-39c311114b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ff983f714204371aeeb752a36d9a584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:00:49Z,use_quota=True,user_id='4c175853d8fc4bbf9cc0859812357955',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] Creating volume ae1b9a58-4571-429b-8d87-39c311114b46 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:00:48 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ae1b9a58-4571-429b-8d87-39c311114b46 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:48 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ae1b9a58-4571-429b-8d87-39c311114b46 1073741824 Sep 10 20:00:48 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:48 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-353b7b8c-836c-4a83-a131-8c35578891e4 tempest-CreateVolumesFromImageTest-1531560306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-61dc8d83-e635-43ed-af9c-5c66cbd9f23e" returned: 0 in 0.262s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:48 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-353b7b8c-836c-4a83-a131-8c35578891e4 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "cinder-quobyte-61dc8d83-e635-43ed-af9c-5c66cbd9f23e" released by "delete_volume" :: held 0.853s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:00:49 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-353b7b8c-836c-4a83-a131-8c35578891e4 tempest-CreateVolumesFromImageTest-1531560306 None] Created reservations ['a6402850-9582-428c-9085-0b9bc6af5f74', '1f9f8dc9-03a8-4614-8f67-0b7bb78fcc67', 'f50d3135-67d7-4739-9178-bdca93e52229', 'ea717f9f-deac-48ef-ae1a-41cb604dd157'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:00:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-353b7b8c-836c-4a83-a131-8c35578891e4 tempest-CreateVolumesFromImageTest-1531560306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-353b7b8c-836c-4a83-a131-8c35578891e4 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-353b7b8c-836c-4a83-a131-8c35578891e4 tempest-CreateVolumesFromImageTest-1531560306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:00:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-353b7b8c-836c-4a83-a131-8c35578891e4 tempest-CreateVolumesFromImageTest-1531560306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:00:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-353b7b8c-836c-4a83-a131-8c35578891e4 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-353b7b8c-836c-4a83-a131-8c35578891e4 tempest-CreateVolumesFromImageTest-1531560306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:49 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:00:49 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e651a792-c22f-4f98-bac8-dd5818125442 tempest-CreateVolumesFromImageTest-1531560306 None] Acquiring lock "cinder-dc103b71-37d9-4db8-bd47-8562f049376f-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:00:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e651a792-c22f-4f98-bac8-dd5818125442 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "cinder-dc103b71-37d9-4db8-bd47-8562f049376f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:00:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e651a792-c22f-4f98-bac8-dd5818125442 tempest-CreateVolumesFromImageTest-1531560306 None] Acquiring lock "cinder-quobyte-dc103b71-37d9-4db8-bd47-8562f049376f" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:00:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e651a792-c22f-4f98-bac8-dd5818125442 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "cinder-quobyte-dc103b71-37d9-4db8-bd47-8562f049376f" acquired by "delete_volume" :: waited 0.021s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:00:49 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[86db30b8-cf0e-4d83-9f46-42bb9dcffadc]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:00:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e651a792-c22f-4f98-bac8-dd5818125442 tempest-CreateVolumesFromImageTest-1531560306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-dc103b71-37d9-4db8-bd47-8562f049376f {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:49 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ae1b9a58-4571-429b-8d87-39c311114b46 1073741824" returned: 0 in 0.589s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:49 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-353b7b8c-836c-4a83-a131-8c35578891e4 tempest-CreateVolumesFromImageTest-1531560306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.393s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:49 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-353b7b8c-836c-4a83-a131-8c35578891e4 tempest-CreateVolumesFromImageTest-1531560306 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:00:49 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-353b7b8c-836c-4a83-a131-8c35578891e4 tempest-CreateVolumesFromImageTest-1531560306 None] Deleted volume successfully. Sep 10 20:00:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-353b7b8c-836c-4a83-a131-8c35578891e4 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "cinder-61dc8d83-e635-43ed-af9c-5c66cbd9f23e-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:00:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ae1b9a58-4571-429b-8d87-39c311114b46 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:49 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ae1b9a58-4571-429b-8d87-39c311114b46 Sep 10 20:00:49 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:49 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-dc103b71-37d9-4db8-bd47-8562f049376f Sep 10 20:00:49 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:49 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ae1b9a58-4571-429b-8d87-39c311114b46" returned: 0 in 0.267s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:00:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac8d3170-a7e6-48aa-ace7-39bf39bfcf06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae1b9a58-4571-429b-8d87-39c311114b46', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a464c99b-ee6f-4ee4-8e1f-dcaaa355a2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:49 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] Volume volume-ae1b9a58-4571-429b-8d87-39c311114b46 (ae1b9a58-4571-429b-8d87-39c311114b46): created successfully Sep 10 20:00:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a464c99b-ee6f-4ee4-8e1f-dcaaa355a2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] Flow 'volume_create_manager' (4e5c9e47-513e-4207-bcfb-aeb7c1042883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:00:49 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e651a792-c22f-4f98-bac8-dd5818125442 tempest-CreateVolumesFromImageTest-1531560306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-dc103b71-37d9-4db8-bd47-8562f049376f" returned: 0 in 0.477s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e651a792-c22f-4f98-bac8-dd5818125442 tempest-CreateVolumesFromImageTest-1531560306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-dc103b71-37d9-4db8-bd47-8562f049376f {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:49 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-dc103b71-37d9-4db8-bd47-8562f049376f Sep 10 20:00:49 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:50 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-903da67b-ed66-45d8-85d3-839b24a91662 tempest-CinderUnicodeTest-1464350107 None] Created volume successfully. Sep 10 20:00:50 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e651a792-c22f-4f98-bac8-dd5818125442 tempest-CreateVolumesFromImageTest-1531560306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-dc103b71-37d9-4db8-bd47-8562f049376f" returned: 0 in 0.271s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:50 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e651a792-c22f-4f98-bac8-dd5818125442 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "cinder-quobyte-dc103b71-37d9-4db8-bd47-8562f049376f" released by "delete_volume" :: held 0.794s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:00:50 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-e651a792-c22f-4f98-bac8-dd5818125442 tempest-CreateVolumesFromImageTest-1531560306 None] Created reservations ['1aec8643-86b9-4594-8bf2-e382ec4c6861', '5a2dec4a-aaee-48f5-ad91-62888c5568d8', 'f0625053-4bbe-419f-8b1e-66dddeba20ab', 'eb0a5e7d-088d-45a7-8188-6d2d28a39d8e'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:00:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e651a792-c22f-4f98-bac8-dd5818125442 tempest-CreateVolumesFromImageTest-1531560306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e651a792-c22f-4f98-bac8-dd5818125442 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:50 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e651a792-c22f-4f98-bac8-dd5818125442 tempest-CreateVolumesFromImageTest-1531560306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:00:50 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e651a792-c22f-4f98-bac8-dd5818125442 tempest-CreateVolumesFromImageTest-1531560306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:00:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e651a792-c22f-4f98-bac8-dd5818125442 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e651a792-c22f-4f98-bac8-dd5818125442 tempest-CreateVolumesFromImageTest-1531560306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:50 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:00:50 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:50 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cdde08cf-680a-4c06-8a90-dd58b54aab8b tempest-CreateVolumesFromImageTest-1531560306 None] Acquiring lock "cinder-87ba43bc-ae93-45b8-85e3-8b241df4c967-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:00:50 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cdde08cf-680a-4c06-8a90-dd58b54aab8b tempest-CreateVolumesFromImageTest-1531560306 None] Lock "cinder-87ba43bc-ae93-45b8-85e3-8b241df4c967-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:00:50 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cdde08cf-680a-4c06-8a90-dd58b54aab8b tempest-CreateVolumesFromImageTest-1531560306 None] Acquiring lock "cinder-quobyte-87ba43bc-ae93-45b8-85e3-8b241df4c967" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:00:50 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cdde08cf-680a-4c06-8a90-dd58b54aab8b tempest-CreateVolumesFromImageTest-1531560306 None] Lock "cinder-quobyte-87ba43bc-ae93-45b8-85e3-8b241df4c967" acquired by "delete_volume" :: waited 0.016s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:00:50 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e651a792-c22f-4f98-bac8-dd5818125442 tempest-CreateVolumesFromImageTest-1531560306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.255s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:50 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-e651a792-c22f-4f98-bac8-dd5818125442 tempest-CreateVolumesFromImageTest-1531560306 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:00:50 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-e651a792-c22f-4f98-bac8-dd5818125442 tempest-CreateVolumesFromImageTest-1531560306 None] Deleted volume successfully. Sep 10 20:00:50 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adf2404-6c42-43d7-9e83-cf217b84100a]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:00:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cdde08cf-680a-4c06-8a90-dd58b54aab8b tempest-CreateVolumesFromImageTest-1531560306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-87ba43bc-ae93-45b8-85e3-8b241df4c967 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:50 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e651a792-c22f-4f98-bac8-dd5818125442 tempest-CreateVolumesFromImageTest-1531560306 None] Lock "cinder-dc103b71-37d9-4db8-bd47-8562f049376f-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:00:50 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-87ba43bc-ae93-45b8-85e3-8b241df4c967 Sep 10 20:00:50 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:51 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cdde08cf-680a-4c06-8a90-dd58b54aab8b tempest-CreateVolumesFromImageTest-1531560306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-87ba43bc-ae93-45b8-85e3-8b241df4c967" returned: 0 in 0.403s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cdde08cf-680a-4c06-8a90-dd58b54aab8b tempest-CreateVolumesFromImageTest-1531560306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-87ba43bc-ae93-45b8-85e3-8b241df4c967 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:51 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-87ba43bc-ae93-45b8-85e3-8b241df4c967 Sep 10 20:00:51 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:51 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cdde08cf-680a-4c06-8a90-dd58b54aab8b tempest-CreateVolumesFromImageTest-1531560306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-87ba43bc-ae93-45b8-85e3-8b241df4c967" returned: 0 in 0.277s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cdde08cf-680a-4c06-8a90-dd58b54aab8b tempest-CreateVolumesFromImageTest-1531560306 None] Lock "cinder-quobyte-87ba43bc-ae93-45b8-85e3-8b241df4c967" released by "delete_volume" :: held 0.729s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-cdde08cf-680a-4c06-8a90-dd58b54aab8b tempest-CreateVolumesFromImageTest-1531560306 None] Created reservations ['9e00ff89-7d51-4982-9164-7064baedf0a2', 'f6d25ae1-a332-4a51-bb34-592c254f358a', '2232ab1e-afee-401d-8049-9fef81b16c6d', 'bec12591-e936-4eef-b4a2-d9908ff87937'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] Flow 'volume_create_manager' (371de7a9-c2e2-4ff2-b607-5a9b7d551d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ed2769c-ce4b-4f5c-9eae-f37f77dfb5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ed2769c-ce4b-4f5c-9eae-f37f77dfb5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:00:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-625484609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a5c1ece-9109-4008-9a0b-3a0aaf1f2301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ff983f714204371aeeb752a36d9a584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:00:51Z,use_quota=True,user_id='4c175853d8fc4bbf9cc0859812357955',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e533415e-1455-4bfd-9745-b342ab61466a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e533415e-1455-4bfd-9745-b342ab61466a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f31a20c6-3308-429c-a200-5013d4f5d44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f31a20c6-3308-429c-a200-5013d4f5d44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a5c1ece-9109-4008-9a0b-3a0aaf1f2301', 'volume_name': 'volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (539b08ff-9639-48fe-8d52-c63e74d92560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (539b08ff-9639-48fe-8d52-c63e74d92560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c426b57-109a-4b3d-b25b-373a8ccab638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:51 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] Volume 1a5c1ece-9109-4008-9a0b-3a0aaf1f2301: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301', 'volume_size': 1} Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:00:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-625484609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a5c1ece-9109-4008-9a0b-3a0aaf1f2301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ff983f714204371aeeb752a36d9a584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:00:51Z,use_quota=True,user_id='4c175853d8fc4bbf9cc0859812357955',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] Creating volume 1a5c1ece-9109-4008-9a0b-3a0aaf1f2301 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:00:51 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:51 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301 1073741824 Sep 10 20:00:51 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cdde08cf-680a-4c06-8a90-dd58b54aab8b tempest-CreateVolumesFromImageTest-1531560306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cdde08cf-680a-4c06-8a90-dd58b54aab8b tempest-CreateVolumesFromImageTest-1531560306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-cdde08cf-680a-4c06-8a90-dd58b54aab8b tempest-CreateVolumesFromImageTest-1531560306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-cdde08cf-680a-4c06-8a90-dd58b54aab8b tempest-CreateVolumesFromImageTest-1531560306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cdde08cf-680a-4c06-8a90-dd58b54aab8b tempest-CreateVolumesFromImageTest-1531560306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cdde08cf-680a-4c06-8a90-dd58b54aab8b tempest-CreateVolumesFromImageTest-1531560306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:51 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:00:51 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:51 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cdde08cf-680a-4c06-8a90-dd58b54aab8b tempest-CreateVolumesFromImageTest-1531560306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.310s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-cdde08cf-680a-4c06-8a90-dd58b54aab8b tempest-CreateVolumesFromImageTest-1531560306 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:00:51 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-cdde08cf-680a-4c06-8a90-dd58b54aab8b tempest-CreateVolumesFromImageTest-1531560306 None] Deleted volume successfully. Sep 10 20:00:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cdde08cf-680a-4c06-8a90-dd58b54aab8b tempest-CreateVolumesFromImageTest-1531560306 None] Lock "cinder-87ba43bc-ae93-45b8-85e3-8b241df4c967-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:00:52 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301 1073741824" returned: 0 in 0.542s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:52 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301 Sep 10 20:00:52 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:52 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301" returned: 0 in 0.299s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:52 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:00:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:52 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c426b57-109a-4b3d-b25b-373a8ccab638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:52 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61e4c72d-e9d8-465b-b54e-ec0028d3d52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:52 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] Volume volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301 (1a5c1ece-9109-4008-9a0b-3a0aaf1f2301): created successfully Sep 10 20:00:52 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61e4c72d-e9d8-465b-b54e-ec0028d3d52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:52 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] Flow 'volume_create_manager' (371de7a9-c2e2-4ff2-b607-5a9b7d551d58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:00:52 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-55047a60-0f80-462e-a23e-99b47766bd5b tempest-CinderUnicodeTest-1464350107 None] Created volume successfully. Sep 10 20:00:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6cab7438-d167-4531-a78f-714c426f1321 tempest-CinderUnicodeTest-1464350107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6cab7438-d167-4531-a78f-714c426f1321 tempest-CinderUnicodeTest-1464350107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:53 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-6cab7438-d167-4531-a78f-714c426f1321 tempest-CinderUnicodeTest-1464350107 None] Creating offline snapshot 459e7bb7-76b6-412c-b482-650f8fe8ee94 of volume 1a5c1ece-9109-4008-9a0b-3a0aaf1f2301 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:00:53 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[4287601b-4519-4ae6-ab76-477fefb90d34]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:00:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6cab7438-d167-4531-a78f-714c426f1321 tempest-CinderUnicodeTest-1464350107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:53 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301 Sep 10 20:00:53 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:54 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6cab7438-d167-4531-a78f-714c426f1321 tempest-CinderUnicodeTest-1464350107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301" returned: 0 in 0.382s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6cab7438-d167-4531-a78f-714c426f1321 tempest-CinderUnicodeTest-1464350107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301.459e7bb7-76b6-412c-b482-650f8fe8ee94 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:54 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301.459e7bb7-76b6-412c-b482-650f8fe8ee94 1G Sep 10 20:00:54 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:54 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:00:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] Flow 'volume_create_manager' (0a24496e-8a59-4923-99c5-825e9c316423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:00:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65ecc1d4-eec2-447b-bcc2-1357d963030c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65ecc1d4-eec2-447b-bcc2-1357d963030c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1402389732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b142f958-d662-478f-9fdc-3fb8bc3a7b71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a5097ec1ea499dbc82b9525fde6248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:00:55Z,use_quota=True,user_id='2cdbefb7c33d44ed9e47e0ff606bec62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a10b327a-563f-4d8e-8b9f-6ede88be0972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a10b327a-563f-4d8e-8b9f-6ede88be0972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:54 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0deee5-f292-41e3-9ef1-5338ed027437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0deee5-f292-41e3-9ef1-5338ed027437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b142f958-d662-478f-9fdc-3fb8bc3a7b71', 'volume_name': 'volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853ee2e7-b86b-41cb-afa8-8c71b402968a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853ee2e7-b86b-41cb-afa8-8c71b402968a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:54 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea51c081-6b5d-40ea-9798-e3111cbebce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:54 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] Volume b142f958-d662-478f-9fdc-3fb8bc3a7b71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71', 'volume_size': 1} Sep 10 20:00:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6cab7438-d167-4531-a78f-714c426f1321 tempest-CinderUnicodeTest-1464350107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301.459e7bb7-76b6-412c-b482-650f8fe8ee94 1G" returned: 0 in 0.484s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6cab7438-d167-4531-a78f-714c426f1321 tempest-CinderUnicodeTest-1464350107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301.459e7bb7-76b6-412c-b482-650f8fe8ee94 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:54 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301.459e7bb7-76b6-412c-b482-650f8fe8ee94 Sep 10 20:00:54 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:54 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6cab7438-d167-4531-a78f-714c426f1321 tempest-CinderUnicodeTest-1464350107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301.459e7bb7-76b6-412c-b482-650f8fe8ee94" returned: 0 in 0.306s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:54 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-6cab7438-d167-4531-a78f-714c426f1321 tempest-CinderUnicodeTest-1464350107 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301.459e7bb7-76b6-412c-b482-650f8fe8ee94 is being set with open permissions: ugo+rw Sep 10 20:00:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6cab7438-d167-4531-a78f-714c426f1321 tempest-CinderUnicodeTest-1464350107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301.459e7bb7-76b6-412c-b482-650f8fe8ee94 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:55 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301.459e7bb7-76b6-412c-b482-650f8fe8ee94 Sep 10 20:00:55 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:55 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6cab7438-d167-4531-a78f-714c426f1321 tempest-CinderUnicodeTest-1464350107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301.459e7bb7-76b6-412c-b482-650f8fe8ee94" returned: 0 in 0.303s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6cab7438-d167-4531-a78f-714c426f1321 tempest-CinderUnicodeTest-1464350107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:55 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301.info Sep 10 20:00:55 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:55 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6cab7438-d167-4531-a78f-714c426f1321 tempest-CinderUnicodeTest-1464350107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301.info" returned: 0 in 0.252s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:55 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-6cab7438-d167-4531-a78f-714c426f1321 tempest-CinderUnicodeTest-1464350107 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301.info is being set with open permissions: ugo+rw Sep 10 20:00:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6cab7438-d167-4531-a78f-714c426f1321 tempest-CinderUnicodeTest-1464350107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:55 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301.info Sep 10 20:00:55 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:55 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6cab7438-d167-4531-a78f-714c426f1321 tempest-CinderUnicodeTest-1464350107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301.info" returned: 0 in 0.268s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6cab7438-d167-4531-a78f-714c426f1321 tempest-CinderUnicodeTest-1464350107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.101s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.204s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:55 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1402389732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b142f958-d662-478f-9fdc-3fb8bc3a7b71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a5097ec1ea499dbc82b9525fde6248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:00:55Z,use_quota=True,user_id='2cdbefb7c33d44ed9e47e0ff606bec62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:00:55 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] Creating volume b142f958-d662-478f-9fdc-3fb8bc3a7b71 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:00:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:55 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:00:55 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:00:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:55 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:00:55 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:00:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:55 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71 1073741824 Sep 10 20:00:55 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:55 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-6cab7438-d167-4531-a78f-714c426f1321 tempest-CinderUnicodeTest-1464350107 None] Create snapshot completed successfully Sep 10 20:00:56 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71 1073741824" returned: 0 in 0.410s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:56 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71 Sep 10 20:00:56 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:56 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71" returned: 0 in 0.249s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:00:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea51c081-6b5d-40ea-9798-e3111cbebce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af808d4-41a9-4eda-ab76-ad1e4b505191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:00:56 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] Volume volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71 (b142f958-d662-478f-9fdc-3fb8bc3a7b71): created successfully Sep 10 20:00:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af808d4-41a9-4eda-ab76-ad1e4b505191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:00:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] Flow 'volume_create_manager' (0a24496e-8a59-4923-99c5-825e9c316423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:00:56 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-f6474b67-3997-481d-a073-820ca7645d89 tempest-CreateVolumesFromSnapshotTest-61759576 None] Created volume successfully. Sep 10 20:00:56 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f45ddfdb-710a-4b03-b416-7d0d5143314a tempest-CinderUnicodeTest-1464350107 None] Acquiring lock "cinder-459e7bb7-76b6-412c-b482-650f8fe8ee94-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:00:56 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f45ddfdb-710a-4b03-b416-7d0d5143314a tempest-CinderUnicodeTest-1464350107 None] Lock "cinder-459e7bb7-76b6-412c-b482-650f8fe8ee94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:00:56 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f45ddfdb-710a-4b03-b416-7d0d5143314a tempest-CinderUnicodeTest-1464350107 None] Acquiring lock "cinder-quobyte-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:00:56 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f45ddfdb-710a-4b03-b416-7d0d5143314a tempest-CinderUnicodeTest-1464350107 None] Lock "cinder-quobyte-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:00:56 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f45ddfdb-710a-4b03-b416-7d0d5143314a tempest-CinderUnicodeTest-1464350107 None] Acquiring lock "cinder-quobyte-459e7bb7-76b6-412c-b482-650f8fe8ee94" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:00:57 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f45ddfdb-710a-4b03-b416-7d0d5143314a tempest-CinderUnicodeTest-1464350107 None] Lock "cinder-quobyte-459e7bb7-76b6-412c-b482-650f8fe8ee94" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:00:57 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-f45ddfdb-710a-4b03-b416-7d0d5143314a tempest-CinderUnicodeTest-1464350107 None] Deleting offline snapshot 459e7bb7-76b6-412c-b482-650f8fe8ee94 of volume 1a5c1ece-9109-4008-9a0b-3a0aaf1f2301 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:00:57 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-f45ddfdb-710a-4b03-b416-7d0d5143314a tempest-CinderUnicodeTest-1464350107 None] snapshot_file for this snap is: volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301.459e7bb7-76b6-412c-b482-650f8fe8ee94 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:00:57 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2c10b7-0f5c-49f7-ac3d-f5ee731f2fda]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:00:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f45ddfdb-710a-4b03-b416-7d0d5143314a tempest-CinderUnicodeTest-1464350107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301.459e7bb7-76b6-412c-b482-650f8fe8ee94 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:57 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301.459e7bb7-76b6-412c-b482-650f8fe8ee94 Sep 10 20:00:57 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:57 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f45ddfdb-710a-4b03-b416-7d0d5143314a tempest-CinderUnicodeTest-1464350107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301.459e7bb7-76b6-412c-b482-650f8fe8ee94" returned: 0 in 0.356s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:57 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-f45ddfdb-710a-4b03-b416-7d0d5143314a tempest-CinderUnicodeTest-1464350107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:00:57 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdd1f11-6eb9-4c7c-bbe0-d90b042eb903]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:00:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f45ddfdb-710a-4b03-b416-7d0d5143314a tempest-CinderUnicodeTest-1464350107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:57 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301 Sep 10 20:00:57 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:57 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f45ddfdb-710a-4b03-b416-7d0d5143314a tempest-CinderUnicodeTest-1464350107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301" returned: 0 in 0.356s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f45ddfdb-710a-4b03-b416-7d0d5143314a tempest-CinderUnicodeTest-1464350107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301.459e7bb7-76b6-412c-b482-650f8fe8ee94 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:57 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301.459e7bb7-76b6-412c-b482-650f8fe8ee94 Sep 10 20:00:57 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c76d23e8-bd04-49ba-9cea-c66e1d442066 tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:00:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c76d23e8-bd04-49ba-9cea-c66e1d442066 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:00:57 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-c76d23e8-bd04-49ba-9cea-c66e1d442066 tempest-CreateVolumesFromSnapshotTest-61759576 None] Creating offline snapshot 7e261abb-ec29-47a4-b811-4101519d3bf2 of volume b142f958-d662-478f-9fdc-3fb8bc3a7b71 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:00:57 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a089f5-edad-4893-841e-1c4c429a5371]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:00:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c76d23e8-bd04-49ba-9cea-c66e1d442066 tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:58 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71 Sep 10 20:00:58 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:58 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f45ddfdb-710a-4b03-b416-7d0d5143314a tempest-CinderUnicodeTest-1464350107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301.459e7bb7-76b6-412c-b482-650f8fe8ee94" returned: 0 in 0.379s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f45ddfdb-710a-4b03-b416-7d0d5143314a tempest-CinderUnicodeTest-1464350107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301.459e7bb7-76b6-412c-b482-650f8fe8ee94 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:58 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301.459e7bb7-76b6-412c-b482-650f8fe8ee94 Sep 10 20:00:58 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:58 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c76d23e8-bd04-49ba-9cea-c66e1d442066 tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71" returned: 0 in 0.401s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c76d23e8-bd04-49ba-9cea-c66e1d442066 tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71.7e261abb-ec29-47a4-b811-4101519d3bf2 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:58 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71.7e261abb-ec29-47a4-b811-4101519d3bf2 1G Sep 10 20:00:58 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:58 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f45ddfdb-710a-4b03-b416-7d0d5143314a tempest-CinderUnicodeTest-1464350107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301.459e7bb7-76b6-412c-b482-650f8fe8ee94" returned: 0 in 0.256s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:58 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f45ddfdb-710a-4b03-b416-7d0d5143314a tempest-CinderUnicodeTest-1464350107 None] Lock "cinder-quobyte-459e7bb7-76b6-412c-b482-650f8fe8ee94" released by "_delete_snapshot" :: held 1.449s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:00:58 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f45ddfdb-710a-4b03-b416-7d0d5143314a tempest-CinderUnicodeTest-1464350107 None] Lock "cinder-quobyte-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301" released by "delete_snapshot" :: held 1.472s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:00:58 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-f45ddfdb-710a-4b03-b416-7d0d5143314a tempest-CinderUnicodeTest-1464350107 None] Created reservations ['2b802f80-edae-4f65-a6f0-aff5ed6d2665', '1b0f4585-b168-4384-b36f-f8fc5fd07dd3', '86ecec85-2943-404f-aae0-ecfc8ea814df', '5016a2f1-4bf1-4c3f-9337-0ada59f9efde'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:00:58 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-f45ddfdb-710a-4b03-b416-7d0d5143314a tempest-CinderUnicodeTest-1464350107 None] Delete snapshot completed successfully. Sep 10 20:00:58 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f45ddfdb-710a-4b03-b416-7d0d5143314a tempest-CinderUnicodeTest-1464350107 None] Lock "cinder-459e7bb7-76b6-412c-b482-650f8fe8ee94-delete_snapshot" released by "delete_snapshot" :: held 1.611s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:00:58 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c76d23e8-bd04-49ba-9cea-c66e1d442066 tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71.7e261abb-ec29-47a4-b811-4101519d3bf2 1G" returned: 0 in 0.376s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c76d23e8-bd04-49ba-9cea-c66e1d442066 tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71.7e261abb-ec29-47a4-b811-4101519d3bf2 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:58 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71.7e261abb-ec29-47a4-b811-4101519d3bf2 Sep 10 20:00:58 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:59 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c76d23e8-bd04-49ba-9cea-c66e1d442066 tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71.7e261abb-ec29-47a4-b811-4101519d3bf2" returned: 0 in 0.278s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:59 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-c76d23e8-bd04-49ba-9cea-c66e1d442066 tempest-CreateVolumesFromSnapshotTest-61759576 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71.7e261abb-ec29-47a4-b811-4101519d3bf2 is being set with open permissions: ugo+rw Sep 10 20:00:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c76d23e8-bd04-49ba-9cea-c66e1d442066 tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71.7e261abb-ec29-47a4-b811-4101519d3bf2 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:59 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71.7e261abb-ec29-47a4-b811-4101519d3bf2 Sep 10 20:00:59 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:59 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a0ae1811-6a82-451a-99df-5ca7a79b9ab4 tempest-CinderUnicodeTest-1464350107 None] Acquiring lock "cinder-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:00:59 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a0ae1811-6a82-451a-99df-5ca7a79b9ab4 tempest-CinderUnicodeTest-1464350107 None] Lock "cinder-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:00:59 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a0ae1811-6a82-451a-99df-5ca7a79b9ab4 tempest-CinderUnicodeTest-1464350107 None] Acquiring lock "cinder-quobyte-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:00:59 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a0ae1811-6a82-451a-99df-5ca7a79b9ab4 tempest-CinderUnicodeTest-1464350107 None] Lock "cinder-quobyte-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301" acquired by "delete_volume" :: waited 0.020s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:00:59 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c67ec68-7b0b-4fc4-bd45-c15d3737b55f]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:00:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a0ae1811-6a82-451a-99df-5ca7a79b9ab4 tempest-CinderUnicodeTest-1464350107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:59 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c76d23e8-bd04-49ba-9cea-c66e1d442066 tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71.7e261abb-ec29-47a4-b811-4101519d3bf2" returned: 0 in 0.285s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:59 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301 Sep 10 20:00:59 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c76d23e8-bd04-49ba-9cea-c66e1d442066 tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:59 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71.info Sep 10 20:00:59 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:59 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a0ae1811-6a82-451a-99df-5ca7a79b9ab4 tempest-CinderUnicodeTest-1464350107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301" returned: 0 in 0.366s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a0ae1811-6a82-451a-99df-5ca7a79b9ab4 tempest-CinderUnicodeTest-1464350107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:59 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:59 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301 Sep 10 20:00:59 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c76d23e8-bd04-49ba-9cea-c66e1d442066 tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71.info" returned: 0 in 0.262s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:59 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-c76d23e8-bd04-49ba-9cea-c66e1d442066 tempest-CreateVolumesFromSnapshotTest-61759576 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71.info is being set with open permissions: ugo+rw Sep 10 20:00:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c76d23e8-bd04-49ba-9cea-c66e1d442066 tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:59 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71.info Sep 10 20:00:59 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:59 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a0ae1811-6a82-451a-99df-5ca7a79b9ab4 tempest-CinderUnicodeTest-1464350107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301" returned: 0 in 0.250s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:59 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a0ae1811-6a82-451a-99df-5ca7a79b9ab4 tempest-CinderUnicodeTest-1464350107 None] Lock "cinder-quobyte-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301" released by "delete_volume" :: held 0.671s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:00:59 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c76d23e8-bd04-49ba-9cea-c66e1d442066 tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71.info" returned: 0 in 0.264s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c76d23e8-bd04-49ba-9cea-c66e1d442066 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.967s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:00:59 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-c76d23e8-bd04-49ba-9cea-c66e1d442066 tempest-CreateVolumesFromSnapshotTest-61759576 None] Create snapshot completed successfully Sep 10 20:00:59 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-a0ae1811-6a82-451a-99df-5ca7a79b9ab4 tempest-CinderUnicodeTest-1464350107 None] Created reservations ['40eed8a6-3f04-4580-b3a5-3cf3af77bec1', '3aafc242-928b-438c-b763-fa4135b4ddea', 'b90481e5-2420-422a-a7a3-c560bf0dfd9e', '393c9971-e9f5-4389-b052-3bb2f736c06a'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a0ae1811-6a82-451a-99df-5ca7a79b9ab4 tempest-CinderUnicodeTest-1464350107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a0ae1811-6a82-451a-99df-5ca7a79b9ab4 tempest-CinderUnicodeTest-1464350107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a0ae1811-6a82-451a-99df-5ca7a79b9ab4 tempest-CinderUnicodeTest-1464350107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a0ae1811-6a82-451a-99df-5ca7a79b9ab4 tempest-CinderUnicodeTest-1464350107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a0ae1811-6a82-451a-99df-5ca7a79b9ab4 tempest-CinderUnicodeTest-1464350107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a0ae1811-6a82-451a-99df-5ca7a79b9ab4 tempest-CinderUnicodeTest-1464350107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:00 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:01:00 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:00 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a0ae1811-6a82-451a-99df-5ca7a79b9ab4 tempest-CinderUnicodeTest-1464350107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.254s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-a0ae1811-6a82-451a-99df-5ca7a79b9ab4 tempest-CinderUnicodeTest-1464350107 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:01:00 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-a0ae1811-6a82-451a-99df-5ca7a79b9ab4 tempest-CinderUnicodeTest-1464350107 None] Deleted volume successfully. Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-8001206c-efac-4057-aa12-65d928d48cd0 tempest-CinderUnicodeTest-1464350107 None] Acquiring lock "cinder-ae1b9a58-4571-429b-8d87-39c311114b46-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-a0ae1811-6a82-451a-99df-5ca7a79b9ab4 tempest-CinderUnicodeTest-1464350107 None] Lock "cinder-1a5c1ece-9109-4008-9a0b-3a0aaf1f2301-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-8001206c-efac-4057-aa12-65d928d48cd0 tempest-CinderUnicodeTest-1464350107 None] Lock "cinder-ae1b9a58-4571-429b-8d87-39c311114b46-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-8001206c-efac-4057-aa12-65d928d48cd0 tempest-CinderUnicodeTest-1464350107 None] Acquiring lock "cinder-quobyte-ae1b9a58-4571-429b-8d87-39c311114b46" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-8001206c-efac-4057-aa12-65d928d48cd0 tempest-CinderUnicodeTest-1464350107 None] Lock "cinder-quobyte-ae1b9a58-4571-429b-8d87-39c311114b46" acquired by "delete_volume" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10df547-72b0-49ca-acd4-5e98615b41b9]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8001206c-efac-4057-aa12-65d928d48cd0 tempest-CinderUnicodeTest-1464350107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ae1b9a58-4571-429b-8d87-39c311114b46 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:00 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ae1b9a58-4571-429b-8d87-39c311114b46 Sep 10 20:01:00 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] Flow 'volume_create_manager' (fd75a368-3b0e-486e-8b7d-e5b0b2eb3e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (788d4884-6f8d-4be0-bde5-bc8440450366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (788d4884-6f8d-4be0-bde5-bc8440450366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1742190079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=523b0a36-138c-4424-841c-6fb3310de488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a5097ec1ea499dbc82b9525fde6248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:01:01Z,use_quota=True,user_id='2cdbefb7c33d44ed9e47e0ff606bec62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b49fad1e-59b0-4417-9ebc-8f21ff1d125c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b49fad1e-59b0-4417-9ebc-8f21ff1d125c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (422172ae-a809-4b14-8968-debf2692d875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (422172ae-a809-4b14-8968-debf2692d875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '523b0a36-138c-4424-841c-6fb3310de488', 'volume_name': 'volume-523b0a36-138c-4424-841c-6fb3310de488', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da8c3821-8e08-465a-bd1b-5026271fdfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da8c3821-8e08-465a-bd1b-5026271fdfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24f75dc-0786-44e2-8691-f1bcde5c0b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:00 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] Volume 523b0a36-138c-4424-841c-6fb3310de488: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-523b0a36-138c-4424-841c-6fb3310de488', 'volume_size': 1} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1742190079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=523b0a36-138c-4424-841c-6fb3310de488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a5097ec1ea499dbc82b9525fde6248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:01:01Z,use_quota=True,user_id='2cdbefb7c33d44ed9e47e0ff606bec62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] Creating volume 523b0a36-138c-4424-841c-6fb3310de488 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:01:00 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-523b0a36-138c-4424-841c-6fb3310de488 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:00 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-523b0a36-138c-4424-841c-6fb3310de488 1073741824 Sep 10 20:01:00 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:00 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8001206c-efac-4057-aa12-65d928d48cd0 tempest-CinderUnicodeTest-1464350107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ae1b9a58-4571-429b-8d87-39c311114b46" returned: 0 in 0.449s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8001206c-efac-4057-aa12-65d928d48cd0 tempest-CinderUnicodeTest-1464350107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ae1b9a58-4571-429b-8d87-39c311114b46 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:00 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ae1b9a58-4571-429b-8d87-39c311114b46 Sep 10 20:01:00 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:01 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8001206c-efac-4057-aa12-65d928d48cd0 tempest-CinderUnicodeTest-1464350107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ae1b9a58-4571-429b-8d87-39c311114b46" returned: 0 in 0.317s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:01 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-8001206c-efac-4057-aa12-65d928d48cd0 tempest-CinderUnicodeTest-1464350107 None] Lock "cinder-quobyte-ae1b9a58-4571-429b-8d87-39c311114b46" released by "delete_volume" :: held 0.815s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-523b0a36-138c-4424-841c-6fb3310de488 1073741824" returned: 0 in 0.541s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] Flow 'volume_create_manager' (a6c40b25-dda9-41b5-92f8-aa796780572c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e8b4ef-d0e0-4004-81f3-90865259b888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-8001206c-efac-4057-aa12-65d928d48cd0 tempest-CinderUnicodeTest-1464350107 None] Created reservations ['2d1912be-8eaf-4e35-8625-ee9e5fa940d9', '0aa52aab-c80e-47b2-b2c9-5a9dba1cfd39', '9ff08456-2906-427b-b130-6d945d6f1a49', 'e192e5f3-889c-413a-8ecb-c30eb15c1f10'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e8b4ef-d0e0-4004-81f3-90865259b888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-107099943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c88be2-8011-4f81-adc2-cc87c43b08a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a5097ec1ea499dbc82b9525fde6248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:01:01Z,use_quota=True,user_id='2cdbefb7c33d44ed9e47e0ff606bec62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56812b2f-f844-4f41-b306-93818fe44ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56812b2f-f844-4f41-b306-93818fe44ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (524dc5c9-c076-4d75-976d-48941bc27900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (524dc5c9-c076-4d75-976d-48941bc27900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07c88be2-8011-4f81-adc2-cc87c43b08a7', 'volume_name': 'volume-07c88be2-8011-4f81-adc2-cc87c43b08a7', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaca809f-1771-457a-a8e8-ec27acdcdbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaca809f-1771-457a-a8e8-ec27acdcdbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36597d0c-9780-4226-b29c-9f0eb00c6a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:01 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] Volume 07c88be2-8011-4f81-adc2-cc87c43b08a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07c88be2-8011-4f81-adc2-cc87c43b08a7', 'volume_size': 1} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=129,cinder:INSERT=40,cinder:UPDATE=162,cinder:DELETE=11 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-523b0a36-138c-4424-841c-6fb3310de488 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:01 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-523b0a36-138c-4424-841c-6fb3310de488 Sep 10 20:01:01 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-8001206c-efac-4057-aa12-65d928d48cd0 tempest-CinderUnicodeTest-1464350107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-8001206c-efac-4057-aa12-65d928d48cd0 tempest-CinderUnicodeTest-1464350107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-8001206c-efac-4057-aa12-65d928d48cd0 tempest-CinderUnicodeTest-1464350107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-8001206c-efac-4057-aa12-65d928d48cd0 tempest-CinderUnicodeTest-1464350107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-8001206c-efac-4057-aa12-65d928d48cd0 tempest-CinderUnicodeTest-1464350107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8001206c-efac-4057-aa12-65d928d48cd0 tempest-CinderUnicodeTest-1464350107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:01 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:01:01 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] Flow 'volume_create_manager' (7443f143-dc06-4181-80ed-b9344c63eaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5cea000-25a4-418f-83f2-fa417bbd0831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:01 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5cea000-25a4-418f-83f2-fa417bbd0831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1284896189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa38d62c-ef4b-4edd-af33-5bf470214e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a5097ec1ea499dbc82b9525fde6248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:01:02Z,use_quota=True,user_id='2cdbefb7c33d44ed9e47e0ff606bec62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (846ed52f-fbb9-40a9-a9fc-3a31db193cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (846ed52f-fbb9-40a9-a9fc-3a31db193cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2946910-879b-4b7a-b70d-045b4972ec67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2946910-879b-4b7a-b70d-045b4972ec67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa38d62c-ef4b-4edd-af33-5bf470214e18', 'volume_name': 'volume-fa38d62c-ef4b-4edd-af33-5bf470214e18', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e4f354-bd0c-4166-be50-a870fbffb8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e4f354-bd0c-4166-be50-a870fbffb8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca2fc75-e96a-4913-b367-61c7503eee99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:01 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] Volume fa38d62c-ef4b-4edd-af33-5bf470214e18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa38d62c-ef4b-4edd-af33-5bf470214e18', 'volume_size': 1} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-523b0a36-138c-4424-841c-6fb3310de488" returned: 0 in 0.387s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.413s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-107099943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c88be2-8011-4f81-adc2-cc87c43b08a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a5097ec1ea499dbc82b9525fde6248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:01:01Z,use_quota=True,user_id='2cdbefb7c33d44ed9e47e0ff606bec62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] Creating volume 07c88be2-8011-4f81-adc2-cc87c43b08a7 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:01:01 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-07c88be2-8011-4f81-adc2-cc87c43b08a7 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:01 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8001206c-efac-4057-aa12-65d928d48cd0 tempest-CinderUnicodeTest-1464350107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.309s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-8001206c-efac-4057-aa12-65d928d48cd0 tempest-CinderUnicodeTest-1464350107 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:01:01 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-07c88be2-8011-4f81-adc2-cc87c43b08a7 1073741824 Sep 10 20:01:01 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24f75dc-0786-44e2-8691-f1bcde5c0b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-523b0a36-138c-4424-841c-6fb3310de488', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694bfaa1-4faa-4d25-8ead-a0b13e82b2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:01 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-8001206c-efac-4057-aa12-65d928d48cd0 tempest-CinderUnicodeTest-1464350107 None] Deleted volume successfully. Sep 10 20:01:01 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] Volume volume-523b0a36-138c-4424-841c-6fb3310de488 (523b0a36-138c-4424-841c-6fb3310de488): created successfully Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694bfaa1-4faa-4d25-8ead-a0b13e82b2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] Flow 'volume_create_manager' (fd75a368-3b0e-486e-8b7d-e5b0b2eb3e5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:01:01 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-8001206c-efac-4057-aa12-65d928d48cd0 tempest-CinderUnicodeTest-1464350107 None] Lock "cinder-ae1b9a58-4571-429b-8d87-39c311114b46-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:01 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-022a3b62-6d5c-424b-8b34-f54054cd4470 tempest-CreateVolumesFromSnapshotTest-61759576 None] Created volume successfully. Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] Flow 'volume_create_manager' (645ce6d4-d535-4f4d-a870-b91b2f6790b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb36121-0506-4074-96bf-09a046247f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb36121-0506-4074-96bf-09a046247f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-318124995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488017e1-1690-4bb2-a470-274970bf06ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a5097ec1ea499dbc82b9525fde6248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:01:02Z,use_quota=True,user_id='2cdbefb7c33d44ed9e47e0ff606bec62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01eecbff-c328-4415-a36d-d57384d23d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01eecbff-c328-4415-a36d-d57384d23d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6e67ed-09e5-43b6-9226-95b9562bfeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6e67ed-09e5-43b6-9226-95b9562bfeab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '488017e1-1690-4bb2-a470-274970bf06ef', 'volume_name': 'volume-488017e1-1690-4bb2-a470-274970bf06ef', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b6232aa-a2f6-460b-887f-6e7a813edad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b6232aa-a2f6-460b-887f-6e7a813edad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f491ccf2-fa4f-48eb-95d3-327da09296ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:02 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] Volume 488017e1-1690-4bb2-a470-274970bf06ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-488017e1-1690-4bb2-a470-274970bf06ef', 'volume_size': 1} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:02 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-07c88be2-8011-4f81-adc2-cc87c43b08a7 1073741824" returned: 0 in 0.531s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-07c88be2-8011-4f81-adc2-cc87c43b08a7 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:02 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-07c88be2-8011-4f81-adc2-cc87c43b08a7 Sep 10 20:01:02 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] Flow 'volume_create_manager' (8a6d43e8-e737-422d-9a1b-d056cf86701a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0e5289-fe97-4b0b-9bc6-04ca494d2904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0e5289-fe97-4b0b-9bc6-04ca494d2904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-269547533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30858564-c661-41b1-b2a1-7daa9308ca65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a5097ec1ea499dbc82b9525fde6248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:01:02Z,use_quota=True,user_id='2cdbefb7c33d44ed9e47e0ff606bec62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (241b1105-bc3e-494a-adc1-3fc56716aa09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (241b1105-bc3e-494a-adc1-3fc56716aa09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef10ee0d-567d-4e2a-b33e-141c97bb4951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef10ee0d-567d-4e2a-b33e-141c97bb4951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30858564-c661-41b1-b2a1-7daa9308ca65', 'volume_name': 'volume-30858564-c661-41b1-b2a1-7daa9308ca65', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1009630f-9868-4eb1-880f-768ca7537768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1009630f-9868-4eb1-880f-768ca7537768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7956c36-72f7-456b-a6e8-02dbbf60dd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:02 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] Volume 30858564-c661-41b1-b2a1-7daa9308ca65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30858564-c661-41b1-b2a1-7daa9308ca65', 'volume_size': 1} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:02 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-07c88be2-8011-4f81-adc2-cc87c43b08a7" returned: 0 in 0.259s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.848s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1284896189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa38d62c-ef4b-4edd-af33-5bf470214e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a5097ec1ea499dbc82b9525fde6248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:01:02Z,use_quota=True,user_id='2cdbefb7c33d44ed9e47e0ff606bec62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] Creating volume fa38d62c-ef4b-4edd-af33-5bf470214e18 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:01:02 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-fa38d62c-ef4b-4edd-af33-5bf470214e18 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:02 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-fa38d62c-ef4b-4edd-af33-5bf470214e18 1073741824 Sep 10 20:01:02 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36597d0c-9780-4226-b29c-9f0eb00c6a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07c88be2-8011-4f81-adc2-cc87c43b08a7', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e0a9e6d-eee9-4b17-94c5-53e47e2cfebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:02 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] Volume volume-07c88be2-8011-4f81-adc2-cc87c43b08a7 (07c88be2-8011-4f81-adc2-cc87c43b08a7): created successfully Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e0a9e6d-eee9-4b17-94c5-53e47e2cfebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:02 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] Flow 'volume_create_manager' (a6c40b25-dda9-41b5-92f8-aa796780572c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:01:02 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-147580da-28ea-44fd-9d2c-9c03f03ac3c2 tempest-CreateVolumesFromSnapshotTest-61759576 None] Created volume successfully. Sep 10 20:01:03 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-fa38d62c-ef4b-4edd-af33-5bf470214e18 1073741824" returned: 0 in 0.475s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-fa38d62c-ef4b-4edd-af33-5bf470214e18 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:03 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-fa38d62c-ef4b-4edd-af33-5bf470214e18 Sep 10 20:01:03 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:03 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-fa38d62c-ef4b-4edd-af33-5bf470214e18" returned: 0 in 0.348s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:01:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.352s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-318124995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488017e1-1690-4bb2-a470-274970bf06ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a5097ec1ea499dbc82b9525fde6248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:01:02Z,use_quota=True,user_id='2cdbefb7c33d44ed9e47e0ff606bec62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:01:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] Creating volume 488017e1-1690-4bb2-a470-274970bf06ef {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:01:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:01:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:01:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:01:03 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:01:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-488017e1-1690-4bb2-a470-274970bf06ef 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca2fc75-e96a-4913-b367-61c7503eee99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa38d62c-ef4b-4edd-af33-5bf470214e18', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:03 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-488017e1-1690-4bb2-a470-274970bf06ef 1073741824 Sep 10 20:01:03 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6369b52-0a91-4f3d-9ff4-71c5f6a8dbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:03 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] Volume volume-fa38d62c-ef4b-4edd-af33-5bf470214e18 (fa38d62c-ef4b-4edd-af33-5bf470214e18): created successfully Sep 10 20:01:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6369b52-0a91-4f3d-9ff4-71c5f6a8dbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] Flow 'volume_create_manager' (7443f143-dc06-4181-80ed-b9344c63eaa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:01:03 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-26c32d6d-7493-41d3-9637-7ccd1ec44630 tempest-CreateVolumesFromSnapshotTest-61759576 None] Created volume successfully. Sep 10 20:01:03 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:01:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:01:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:01:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:04 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:01:04 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:04 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-488017e1-1690-4bb2-a470-274970bf06ef 1073741824" returned: 0 in 0.627s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-488017e1-1690-4bb2-a470-274970bf06ef {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:04 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-488017e1-1690-4bb2-a470-274970bf06ef Sep 10 20:01:04 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:04 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.427s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:04 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:01:04 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager._thread_info {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:01:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread count: 28 {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:01:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread info: [<_MainThread(MainThread, started 138417491665024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:01:04 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-488017e1-1690-4bb2-a470-274970bf06ef" returned: 0 in 0.329s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:01:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.032s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-269547533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30858564-c661-41b1-b2a1-7daa9308ca65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a5097ec1ea499dbc82b9525fde6248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:01:02Z,use_quota=True,user_id='2cdbefb7c33d44ed9e47e0ff606bec62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:01:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] Creating volume 30858564-c661-41b1-b2a1-7daa9308ca65 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:01:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:01:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:01:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:01:04 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:01:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-30858564-c661-41b1-b2a1-7daa9308ca65 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f491ccf2-fa4f-48eb-95d3-327da09296ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-488017e1-1690-4bb2-a470-274970bf06ef', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:04 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-30858564-c661-41b1-b2a1-7daa9308ca65 1073741824 Sep 10 20:01:04 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42c5510a-6653-421b-b459-0d50561c03d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:04 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] Volume volume-488017e1-1690-4bb2-a470-274970bf06ef (488017e1-1690-4bb2-a470-274970bf06ef): created successfully Sep 10 20:01:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42c5510a-6653-421b-b459-0d50561c03d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] Flow 'volume_create_manager' (645ce6d4-d535-4f4d-a870-b91b2f6790b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:01:04 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-ba971ff2-dfad-45a3-a812-2351ba93b58f tempest-CreateVolumesFromSnapshotTest-61759576 None] Created volume successfully. Sep 10 20:01:05 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-30858564-c661-41b1-b2a1-7daa9308ca65 1073741824" returned: 0 in 0.803s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-30858564-c661-41b1-b2a1-7daa9308ca65 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:05 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-30858564-c661-41b1-b2a1-7daa9308ca65 Sep 10 20:01:05 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:05 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-30858564-c661-41b1-b2a1-7daa9308ca65" returned: 0 in 0.322s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:01:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7956c36-72f7-456b-a6e8-02dbbf60dd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30858564-c661-41b1-b2a1-7daa9308ca65', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2810672-1ea4-4072-a5d4-9126c8903286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:05 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] Volume volume-30858564-c661-41b1-b2a1-7daa9308ca65 (30858564-c661-41b1-b2a1-7daa9308ca65): created successfully Sep 10 20:01:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2810672-1ea4-4072-a5d4-9126c8903286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] Flow 'volume_create_manager' (8a6d43e8-e737-422d-9a1b-d056cf86701a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:01:05 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-c3a4b5c3-8acd-4345-aa8a-bc07d9ce6d3a tempest-CreateVolumesFromSnapshotTest-61759576 None] Created volume successfully. Sep 10 20:01:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b7ec9e0c-43fa-433b-8e05-abea3d4a2da6 tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "cinder-30858564-c661-41b1-b2a1-7daa9308ca65-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b7ec9e0c-43fa-433b-8e05-abea3d4a2da6 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "cinder-30858564-c661-41b1-b2a1-7daa9308ca65-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b7ec9e0c-43fa-433b-8e05-abea3d4a2da6 tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "cinder-quobyte-30858564-c661-41b1-b2a1-7daa9308ca65" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b7ec9e0c-43fa-433b-8e05-abea3d4a2da6 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "cinder-quobyte-30858564-c661-41b1-b2a1-7daa9308ca65" acquired by "delete_volume" :: waited 0.029s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:06 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa317558-ec73-43cb-ac72-4e70ca5c2926]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:01:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b7ec9e0c-43fa-433b-8e05-abea3d4a2da6 tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-30858564-c661-41b1-b2a1-7daa9308ca65 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:06 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-30858564-c661-41b1-b2a1-7daa9308ca65 Sep 10 20:01:06 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:06 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-cf65ea67-f64e-4942-817d-160220cd9aac req-4e96d880-dd5a-4846-8d74-121a32cd10ad tempest-TestShelveInstance-175181298 None] Terminate volume connection completed successfully. Sep 10 20:01:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [req-cf65ea67-f64e-4942-817d-160220cd9aac req-4e96d880-dd5a-4846-8d74-121a32cd10ad tempest-TestShelveInstance-175181298 None] Deleting attachment cd9307a2-37ea-4c06-a864-e90971ddfffb. {{(pid=88093) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 20:01:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-cf65ea67-f64e-4942-817d-160220cd9aac req-88ce10ee-f499-4120-a785-ac4577f071eb tempest-TestShelveInstance-175181298 None] Acquiring lock "cinder-834870d5-d4b7-4bea-b90b-deaaa5065975-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-cf65ea67-f64e-4942-817d-160220cd9aac req-88ce10ee-f499-4120-a785-ac4577f071eb tempest-TestShelveInstance-175181298 None] Lock "cinder-834870d5-d4b7-4bea-b90b-deaaa5065975-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:06 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b7ec9e0c-43fa-433b-8e05-abea3d4a2da6 tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-30858564-c661-41b1-b2a1-7daa9308ca65" returned: 0 in 0.536s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b7ec9e0c-43fa-433b-8e05-abea3d4a2da6 tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-30858564-c661-41b1-b2a1-7daa9308ca65 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-cf65ea67-f64e-4942-817d-160220cd9aac req-88ce10ee-f499-4120-a785-ac4577f071eb tempest-TestShelveInstance-175181298 None] Acquiring lock "cinder-quobyte-834870d5-d4b7-4bea-b90b-deaaa5065975" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:06 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-30858564-c661-41b1-b2a1-7daa9308ca65 Sep 10 20:01:06 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:06 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-cf65ea67-f64e-4942-817d-160220cd9aac req-88ce10ee-f499-4120-a785-ac4577f071eb tempest-TestShelveInstance-175181298 None] Lock "cinder-quobyte-834870d5-d4b7-4bea-b90b-deaaa5065975" acquired by "delete_volume" :: waited 0.030s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:06 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[086fe366-429b-46de-bb37-5ef2410655a0]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:01:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-cf65ea67-f64e-4942-817d-160220cd9aac req-88ce10ee-f499-4120-a785-ac4577f071eb tempest-TestShelveInstance-175181298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-834870d5-d4b7-4bea-b90b-deaaa5065975 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:07 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-834870d5-d4b7-4bea-b90b-deaaa5065975 Sep 10 20:01:07 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:07 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b7ec9e0c-43fa-433b-8e05-abea3d4a2da6 tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-30858564-c661-41b1-b2a1-7daa9308ca65" returned: 0 in 0.317s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b7ec9e0c-43fa-433b-8e05-abea3d4a2da6 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "cinder-quobyte-30858564-c661-41b1-b2a1-7daa9308ca65" released by "delete_volume" :: held 0.921s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:07 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-b7ec9e0c-43fa-433b-8e05-abea3d4a2da6 tempest-CreateVolumesFromSnapshotTest-61759576 None] Created reservations ['b678be84-e17d-4563-a675-c1bf11d2be92', 'c977a15c-0fd5-4b4a-ab79-aa2b1d232f56', '8fdca3e1-8e7d-42e3-aacc-8b2cbf211883', '8636284f-c223-45bc-8b72-c960da8ec3e7'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:01:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b7ec9e0c-43fa-433b-8e05-abea3d4a2da6 tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b7ec9e0c-43fa-433b-8e05-abea3d4a2da6 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b7ec9e0c-43fa-433b-8e05-abea3d4a2da6 tempest-CreateVolumesFromSnapshotTest-61759576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:01:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b7ec9e0c-43fa-433b-8e05-abea3d4a2da6 tempest-CreateVolumesFromSnapshotTest-61759576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:01:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b7ec9e0c-43fa-433b-8e05-abea3d4a2da6 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b7ec9e0c-43fa-433b-8e05-abea3d4a2da6 tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:07 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-cf65ea67-f64e-4942-817d-160220cd9aac req-88ce10ee-f499-4120-a785-ac4577f071eb tempest-TestShelveInstance-175181298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-834870d5-d4b7-4bea-b90b-deaaa5065975" returned: 0 in 0.530s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-cf65ea67-f64e-4942-817d-160220cd9aac req-88ce10ee-f499-4120-a785-ac4577f071eb tempest-TestShelveInstance-175181298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-834870d5-d4b7-4bea-b90b-deaaa5065975 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:07 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:01:07 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:07 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-834870d5-d4b7-4bea-b90b-deaaa5065975 Sep 10 20:01:07 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:07 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b7ec9e0c-43fa-433b-8e05-abea3d4a2da6 tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.307s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:07 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-b7ec9e0c-43fa-433b-8e05-abea3d4a2da6 tempest-CreateVolumesFromSnapshotTest-61759576 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:01:07 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-b7ec9e0c-43fa-433b-8e05-abea3d4a2da6 tempest-CreateVolumesFromSnapshotTest-61759576 None] Deleted volume successfully. Sep 10 20:01:07 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-cf65ea67-f64e-4942-817d-160220cd9aac req-88ce10ee-f499-4120-a785-ac4577f071eb tempest-TestShelveInstance-175181298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-834870d5-d4b7-4bea-b90b-deaaa5065975" returned: 0 in 0.311s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-cf65ea67-f64e-4942-817d-160220cd9aac req-88ce10ee-f499-4120-a785-ac4577f071eb tempest-TestShelveInstance-175181298 None] Lock "cinder-quobyte-834870d5-d4b7-4bea-b90b-deaaa5065975" released by "delete_volume" :: held 0.907s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b7ec9e0c-43fa-433b-8e05-abea3d4a2da6 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "cinder-30858564-c661-41b1-b2a1-7daa9308ca65-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:07 devstack cinder-volume[88093]: DEBUG cinder.quota [req-cf65ea67-f64e-4942-817d-160220cd9aac req-88ce10ee-f499-4120-a785-ac4577f071eb tempest-TestShelveInstance-175181298 None] Created reservations ['952bd5d5-2cb9-4145-b1c3-dc1e3041b3d0', '9395476c-6a86-4571-af3a-34891fd46fe6', 'cf2339ef-85a9-45d1-b652-536b3b321afc', '317d44ce-a532-4d3c-8532-4d180168b7d4'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:01:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-cf65ea67-f64e-4942-817d-160220cd9aac req-88ce10ee-f499-4120-a785-ac4577f071eb tempest-TestShelveInstance-175181298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-cf65ea67-f64e-4942-817d-160220cd9aac req-88ce10ee-f499-4120-a785-ac4577f071eb tempest-TestShelveInstance-175181298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [req-cf65ea67-f64e-4942-817d-160220cd9aac req-88ce10ee-f499-4120-a785-ac4577f071eb tempest-TestShelveInstance-175181298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:01:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [req-cf65ea67-f64e-4942-817d-160220cd9aac req-88ce10ee-f499-4120-a785-ac4577f071eb tempest-TestShelveInstance-175181298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:01:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [req-cf65ea67-f64e-4942-817d-160220cd9aac req-88ce10ee-f499-4120-a785-ac4577f071eb tempest-TestShelveInstance-175181298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-cf65ea67-f64e-4942-817d-160220cd9aac req-88ce10ee-f499-4120-a785-ac4577f071eb tempest-TestShelveInstance-175181298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:08 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:01:08 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:08 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [req-cf65ea67-f64e-4942-817d-160220cd9aac req-88ce10ee-f499-4120-a785-ac4577f071eb tempest-TestShelveInstance-175181298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.311s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:08 devstack cinder-volume[88093]: DEBUG cinder.manager [req-cf65ea67-f64e-4942-817d-160220cd9aac req-88ce10ee-f499-4120-a785-ac4577f071eb tempest-TestShelveInstance-175181298 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:01:08 devstack cinder-volume[88093]: INFO cinder.volume.manager [req-cf65ea67-f64e-4942-817d-160220cd9aac req-88ce10ee-f499-4120-a785-ac4577f071eb tempest-TestShelveInstance-175181298 None] Deleted volume successfully. Sep 10 20:01:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [req-cf65ea67-f64e-4942-817d-160220cd9aac req-88ce10ee-f499-4120-a785-ac4577f071eb tempest-TestShelveInstance-175181298 None] Lock "cinder-834870d5-d4b7-4bea-b90b-deaaa5065975-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-85411e1b-78c3-4616-8f84-69f277e942d9 tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "cinder-488017e1-1690-4bb2-a470-274970bf06ef-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-85411e1b-78c3-4616-8f84-69f277e942d9 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "cinder-488017e1-1690-4bb2-a470-274970bf06ef-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-85411e1b-78c3-4616-8f84-69f277e942d9 tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "cinder-quobyte-488017e1-1690-4bb2-a470-274970bf06ef" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-85411e1b-78c3-4616-8f84-69f277e942d9 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "cinder-quobyte-488017e1-1690-4bb2-a470-274970bf06ef" acquired by "delete_volume" :: waited 0.023s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:08 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cb1c13-a460-4118-ab9b-fcd3add5253a]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:01:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-85411e1b-78c3-4616-8f84-69f277e942d9 tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-488017e1-1690-4bb2-a470-274970bf06ef {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:08 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-488017e1-1690-4bb2-a470-274970bf06ef Sep 10 20:01:08 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:09 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-85411e1b-78c3-4616-8f84-69f277e942d9 tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-488017e1-1690-4bb2-a470-274970bf06ef" returned: 0 in 0.387s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-85411e1b-78c3-4616-8f84-69f277e942d9 tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-488017e1-1690-4bb2-a470-274970bf06ef {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:09 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-488017e1-1690-4bb2-a470-274970bf06ef Sep 10 20:01:09 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:09 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-85411e1b-78c3-4616-8f84-69f277e942d9 tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-488017e1-1690-4bb2-a470-274970bf06ef" returned: 0 in 0.327s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:09 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-85411e1b-78c3-4616-8f84-69f277e942d9 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "cinder-quobyte-488017e1-1690-4bb2-a470-274970bf06ef" released by "delete_volume" :: held 0.770s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:09 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-85411e1b-78c3-4616-8f84-69f277e942d9 tempest-CreateVolumesFromSnapshotTest-61759576 None] Created reservations ['220e2573-3241-4620-afcb-0a2422cc200a', 'eed53b19-a337-4003-86ba-d41e761adb09', '66206ac8-5845-449f-9012-6e7124fe07f6', '83f6fe63-b799-427b-9891-c4976192bae3'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:01:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-85411e1b-78c3-4616-8f84-69f277e942d9 tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-85411e1b-78c3-4616-8f84-69f277e942d9 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:09 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-85411e1b-78c3-4616-8f84-69f277e942d9 tempest-CreateVolumesFromSnapshotTest-61759576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:01:09 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-85411e1b-78c3-4616-8f84-69f277e942d9 tempest-CreateVolumesFromSnapshotTest-61759576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:01:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-85411e1b-78c3-4616-8f84-69f277e942d9 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-85411e1b-78c3-4616-8f84-69f277e942d9 tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:09 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:01:09 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:09 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-efd5d9b3-9016-43a5-8570-9b4e1d2c891c tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "cinder-fa38d62c-ef4b-4edd-af33-5bf470214e18-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:09 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-efd5d9b3-9016-43a5-8570-9b4e1d2c891c tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "cinder-fa38d62c-ef4b-4edd-af33-5bf470214e18-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:09 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-efd5d9b3-9016-43a5-8570-9b4e1d2c891c tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "cinder-quobyte-fa38d62c-ef4b-4edd-af33-5bf470214e18" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:09 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-efd5d9b3-9016-43a5-8570-9b4e1d2c891c tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "cinder-quobyte-fa38d62c-ef4b-4edd-af33-5bf470214e18" acquired by "delete_volume" :: waited 0.023s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:09 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76b1a63-1ada-454a-8cdd-2bb56f85b2af]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:01:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-efd5d9b3-9016-43a5-8570-9b4e1d2c891c tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-fa38d62c-ef4b-4edd-af33-5bf470214e18 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:09 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-85411e1b-78c3-4616-8f84-69f277e942d9 tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.326s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:09 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-85411e1b-78c3-4616-8f84-69f277e942d9 tempest-CreateVolumesFromSnapshotTest-61759576 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:01:09 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-85411e1b-78c3-4616-8f84-69f277e942d9 tempest-CreateVolumesFromSnapshotTest-61759576 None] Deleted volume successfully. Sep 10 20:01:09 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-85411e1b-78c3-4616-8f84-69f277e942d9 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "cinder-488017e1-1690-4bb2-a470-274970bf06ef-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:09 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-fa38d62c-ef4b-4edd-af33-5bf470214e18 Sep 10 20:01:09 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:10 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-efd5d9b3-9016-43a5-8570-9b4e1d2c891c tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-fa38d62c-ef4b-4edd-af33-5bf470214e18" returned: 0 in 0.464s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-efd5d9b3-9016-43a5-8570-9b4e1d2c891c tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-fa38d62c-ef4b-4edd-af33-5bf470214e18 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:10 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-fa38d62c-ef4b-4edd-af33-5bf470214e18 Sep 10 20:01:10 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:10 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-efd5d9b3-9016-43a5-8570-9b4e1d2c891c tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-fa38d62c-ef4b-4edd-af33-5bf470214e18" returned: 0 in 0.337s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-efd5d9b3-9016-43a5-8570-9b4e1d2c891c tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "cinder-quobyte-fa38d62c-ef4b-4edd-af33-5bf470214e18" released by "delete_volume" :: held 0.854s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:10 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-efd5d9b3-9016-43a5-8570-9b4e1d2c891c tempest-CreateVolumesFromSnapshotTest-61759576 None] Created reservations ['dd46b91c-bd9c-488f-9c8b-e50596967a4f', '408bcf82-8f58-4254-bfc4-5142d8fa886c', '70c58689-f7a1-473e-ba9c-b4c8131a527f', '2f375137-2e22-4aa0-8e68-2d96309b278d'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:01:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-efd5d9b3-9016-43a5-8570-9b4e1d2c891c tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-efd5d9b3-9016-43a5-8570-9b4e1d2c891c tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:10 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-efd5d9b3-9016-43a5-8570-9b4e1d2c891c tempest-CreateVolumesFromSnapshotTest-61759576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:01:10 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-efd5d9b3-9016-43a5-8570-9b4e1d2c891c tempest-CreateVolumesFromSnapshotTest-61759576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:01:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-efd5d9b3-9016-43a5-8570-9b4e1d2c891c tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-efd5d9b3-9016-43a5-8570-9b4e1d2c891c tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:10 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:01:10 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e77ce922-32bc-4ab1-8e5a-54c0bbe2fc52 tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "cinder-07c88be2-8011-4f81-adc2-cc87c43b08a7-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e77ce922-32bc-4ab1-8e5a-54c0bbe2fc52 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "cinder-07c88be2-8011-4f81-adc2-cc87c43b08a7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:11 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e77ce922-32bc-4ab1-8e5a-54c0bbe2fc52 tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "cinder-quobyte-07c88be2-8011-4f81-adc2-cc87c43b08a7" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:11 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e77ce922-32bc-4ab1-8e5a-54c0bbe2fc52 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "cinder-quobyte-07c88be2-8011-4f81-adc2-cc87c43b08a7" acquired by "delete_volume" :: waited 0.021s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:11 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[330f95e8-49d9-4185-930f-698c30b3ae9a]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:01:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e77ce922-32bc-4ab1-8e5a-54c0bbe2fc52 tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-07c88be2-8011-4f81-adc2-cc87c43b08a7 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:11 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-efd5d9b3-9016-43a5-8570-9b4e1d2c891c tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.348s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:11 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-efd5d9b3-9016-43a5-8570-9b4e1d2c891c tempest-CreateVolumesFromSnapshotTest-61759576 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:01:11 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-efd5d9b3-9016-43a5-8570-9b4e1d2c891c tempest-CreateVolumesFromSnapshotTest-61759576 None] Deleted volume successfully. Sep 10 20:01:11 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-efd5d9b3-9016-43a5-8570-9b4e1d2c891c tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "cinder-fa38d62c-ef4b-4edd-af33-5bf470214e18-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:11 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-07c88be2-8011-4f81-adc2-cc87c43b08a7 Sep 10 20:01:11 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:11 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e77ce922-32bc-4ab1-8e5a-54c0bbe2fc52 tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-07c88be2-8011-4f81-adc2-cc87c43b08a7" returned: 0 in 0.423s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e77ce922-32bc-4ab1-8e5a-54c0bbe2fc52 tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-07c88be2-8011-4f81-adc2-cc87c43b08a7 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:11 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-07c88be2-8011-4f81-adc2-cc87c43b08a7 Sep 10 20:01:11 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:11 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e77ce922-32bc-4ab1-8e5a-54c0bbe2fc52 tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-07c88be2-8011-4f81-adc2-cc87c43b08a7" returned: 0 in 0.284s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:11 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e77ce922-32bc-4ab1-8e5a-54c0bbe2fc52 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "cinder-quobyte-07c88be2-8011-4f81-adc2-cc87c43b08a7" released by "delete_volume" :: held 0.752s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:11 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-e77ce922-32bc-4ab1-8e5a-54c0bbe2fc52 tempest-CreateVolumesFromSnapshotTest-61759576 None] Created reservations ['7713f3ee-9112-4672-9f0b-62da5f2c96ba', '39358584-ee98-453c-bc82-d2d62de74e22', 'a1956cc6-7f4b-4bb1-86fb-117530c12b8b', 'e83742be-f259-4b4f-8f9d-88c1a4c82fb9'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:01:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e77ce922-32bc-4ab1-8e5a-54c0bbe2fc52 tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e77ce922-32bc-4ab1-8e5a-54c0bbe2fc52 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e77ce922-32bc-4ab1-8e5a-54c0bbe2fc52 tempest-CreateVolumesFromSnapshotTest-61759576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:01:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e77ce922-32bc-4ab1-8e5a-54c0bbe2fc52 tempest-CreateVolumesFromSnapshotTest-61759576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:01:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e77ce922-32bc-4ab1-8e5a-54c0bbe2fc52 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e77ce922-32bc-4ab1-8e5a-54c0bbe2fc52 tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:11 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:01:11 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:12 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-48dafbd0-9805-478b-b52a-6fcc0b669734 tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "cinder-523b0a36-138c-4424-841c-6fb3310de488-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:12 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-48dafbd0-9805-478b-b52a-6fcc0b669734 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "cinder-523b0a36-138c-4424-841c-6fb3310de488-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:12 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e77ce922-32bc-4ab1-8e5a-54c0bbe2fc52 tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.287s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:12 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-e77ce922-32bc-4ab1-8e5a-54c0bbe2fc52 tempest-CreateVolumesFromSnapshotTest-61759576 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:01:12 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-48dafbd0-9805-478b-b52a-6fcc0b669734 tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "cinder-quobyte-523b0a36-138c-4424-841c-6fb3310de488" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:12 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-e77ce922-32bc-4ab1-8e5a-54c0bbe2fc52 tempest-CreateVolumesFromSnapshotTest-61759576 None] Deleted volume successfully. Sep 10 20:01:12 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-48dafbd0-9805-478b-b52a-6fcc0b669734 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "cinder-quobyte-523b0a36-138c-4424-841c-6fb3310de488" acquired by "delete_volume" :: waited 0.022s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:12 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e77ce922-32bc-4ab1-8e5a-54c0bbe2fc52 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "cinder-07c88be2-8011-4f81-adc2-cc87c43b08a7-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:12 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c82152-acfc-43b5-8c69-cc47beb48aa6]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:01:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-48dafbd0-9805-478b-b52a-6fcc0b669734 tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-523b0a36-138c-4424-841c-6fb3310de488 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:12 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-523b0a36-138c-4424-841c-6fb3310de488 Sep 10 20:01:12 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:12 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-48dafbd0-9805-478b-b52a-6fcc0b669734 tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-523b0a36-138c-4424-841c-6fb3310de488" returned: 0 in 0.390s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-48dafbd0-9805-478b-b52a-6fcc0b669734 tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-523b0a36-138c-4424-841c-6fb3310de488 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:12 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-523b0a36-138c-4424-841c-6fb3310de488 Sep 10 20:01:12 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:12 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-48dafbd0-9805-478b-b52a-6fcc0b669734 tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-523b0a36-138c-4424-841c-6fb3310de488" returned: 0 in 0.257s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:12 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-48dafbd0-9805-478b-b52a-6fcc0b669734 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "cinder-quobyte-523b0a36-138c-4424-841c-6fb3310de488" released by "delete_volume" :: held 0.689s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:12 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-48dafbd0-9805-478b-b52a-6fcc0b669734 tempest-CreateVolumesFromSnapshotTest-61759576 None] Created reservations ['78557e8c-12e4-4d66-976a-8a77a97c7146', '67546b46-0319-477d-acb2-815ffc6926e4', '8a31e546-9fa7-4d8b-a7db-0cf554f3a2a0', 'e30e5461-271b-4524-a604-dc7e61ccadb0'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:01:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-48dafbd0-9805-478b-b52a-6fcc0b669734 tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-48dafbd0-9805-478b-b52a-6fcc0b669734 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:13 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-48dafbd0-9805-478b-b52a-6fcc0b669734 tempest-CreateVolumesFromSnapshotTest-61759576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:01:13 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-48dafbd0-9805-478b-b52a-6fcc0b669734 tempest-CreateVolumesFromSnapshotTest-61759576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:01:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-48dafbd0-9805-478b-b52a-6fcc0b669734 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-48dafbd0-9805-478b-b52a-6fcc0b669734 tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:13 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:01:13 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:13 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-86537a1d-221f-43fc-96bc-afe2ae978ffb tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "cinder-7e261abb-ec29-47a4-b811-4101519d3bf2-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:13 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-48dafbd0-9805-478b-b52a-6fcc0b669734 tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.274s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:13 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-48dafbd0-9805-478b-b52a-6fcc0b669734 tempest-CreateVolumesFromSnapshotTest-61759576 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:01:13 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-48dafbd0-9805-478b-b52a-6fcc0b669734 tempest-CreateVolumesFromSnapshotTest-61759576 None] Deleted volume successfully. Sep 10 20:01:13 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-86537a1d-221f-43fc-96bc-afe2ae978ffb tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "cinder-7e261abb-ec29-47a4-b811-4101519d3bf2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:13 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-86537a1d-221f-43fc-96bc-afe2ae978ffb tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "cinder-quobyte-b142f958-d662-478f-9fdc-3fb8bc3a7b71" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:13 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-48dafbd0-9805-478b-b52a-6fcc0b669734 tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "cinder-523b0a36-138c-4424-841c-6fb3310de488-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:13 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-86537a1d-221f-43fc-96bc-afe2ae978ffb tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "cinder-quobyte-b142f958-d662-478f-9fdc-3fb8bc3a7b71" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:13 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-86537a1d-221f-43fc-96bc-afe2ae978ffb tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "cinder-quobyte-7e261abb-ec29-47a4-b811-4101519d3bf2" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:13 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-86537a1d-221f-43fc-96bc-afe2ae978ffb tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "cinder-quobyte-7e261abb-ec29-47a4-b811-4101519d3bf2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:13 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-86537a1d-221f-43fc-96bc-afe2ae978ffb tempest-CreateVolumesFromSnapshotTest-61759576 None] Deleting offline snapshot 7e261abb-ec29-47a4-b811-4101519d3bf2 of volume b142f958-d662-478f-9fdc-3fb8bc3a7b71 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:01:13 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-86537a1d-221f-43fc-96bc-afe2ae978ffb tempest-CreateVolumesFromSnapshotTest-61759576 None] snapshot_file for this snap is: volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71.7e261abb-ec29-47a4-b811-4101519d3bf2 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:01:13 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b7eb55-7ab6-49b5-959e-3e39b0d05b60]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:01:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-86537a1d-221f-43fc-96bc-afe2ae978ffb tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71.7e261abb-ec29-47a4-b811-4101519d3bf2 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:13 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71.7e261abb-ec29-47a4-b811-4101519d3bf2 Sep 10 20:01:13 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:13 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-86537a1d-221f-43fc-96bc-afe2ae978ffb tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71.7e261abb-ec29-47a4-b811-4101519d3bf2" returned: 0 in 0.374s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:13 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-86537a1d-221f-43fc-96bc-afe2ae978ffb tempest-CreateVolumesFromSnapshotTest-61759576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:01:13 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c731e7-492a-4fbd-9647-dcbc74312d11]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:01:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-86537a1d-221f-43fc-96bc-afe2ae978ffb tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:14 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71 Sep 10 20:01:14 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:14 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-86537a1d-221f-43fc-96bc-afe2ae978ffb tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71" returned: 0 in 0.436s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-86537a1d-221f-43fc-96bc-afe2ae978ffb tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71.7e261abb-ec29-47a4-b811-4101519d3bf2 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:14 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71.7e261abb-ec29-47a4-b811-4101519d3bf2 Sep 10 20:01:14 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:14 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-86537a1d-221f-43fc-96bc-afe2ae978ffb tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71.7e261abb-ec29-47a4-b811-4101519d3bf2" returned: 0 in 0.352s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-86537a1d-221f-43fc-96bc-afe2ae978ffb tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71.7e261abb-ec29-47a4-b811-4101519d3bf2 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:14 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71.7e261abb-ec29-47a4-b811-4101519d3bf2 Sep 10 20:01:14 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:14 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-86537a1d-221f-43fc-96bc-afe2ae978ffb tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71.7e261abb-ec29-47a4-b811-4101519d3bf2" returned: 0 in 0.243s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-86537a1d-221f-43fc-96bc-afe2ae978ffb tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "cinder-quobyte-7e261abb-ec29-47a4-b811-4101519d3bf2" released by "_delete_snapshot" :: held 1.546s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-86537a1d-221f-43fc-96bc-afe2ae978ffb tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "cinder-quobyte-b142f958-d662-478f-9fdc-3fb8bc3a7b71" released by "delete_snapshot" :: held 1.566s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:15 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-86537a1d-221f-43fc-96bc-afe2ae978ffb tempest-CreateVolumesFromSnapshotTest-61759576 None] Created reservations ['a398f9b0-6d22-4942-932e-8090531ddd36', '1c29740c-3ac0-4abc-ac67-490725dc6cda', '9fb964df-47a4-45b9-bd4b-88da7a93dcbc', '55123b47-f4d7-4302-ba00-a0fa9733d214'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:01:15 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-86537a1d-221f-43fc-96bc-afe2ae978ffb tempest-CreateVolumesFromSnapshotTest-61759576 None] Delete snapshot completed successfully. Sep 10 20:01:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-86537a1d-221f-43fc-96bc-afe2ae978ffb tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "cinder-7e261abb-ec29-47a4-b811-4101519d3bf2-delete_snapshot" released by "delete_snapshot" :: held 1.753s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d7131b44-7544-4c4b-bea9-5c15207922ab tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "cinder-b142f958-d662-478f-9fdc-3fb8bc3a7b71-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d7131b44-7544-4c4b-bea9-5c15207922ab tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "cinder-b142f958-d662-478f-9fdc-3fb8bc3a7b71-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d7131b44-7544-4c4b-bea9-5c15207922ab tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "cinder-quobyte-b142f958-d662-478f-9fdc-3fb8bc3a7b71" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d7131b44-7544-4c4b-bea9-5c15207922ab tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "cinder-quobyte-b142f958-d662-478f-9fdc-3fb8bc3a7b71" acquired by "delete_volume" :: waited 0.012s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:15 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[451e9881-b0d4-4d09-8766-594d22272caf]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:01:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d7131b44-7544-4c4b-bea9-5c15207922ab tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:15 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71 Sep 10 20:01:15 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:16 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d7131b44-7544-4c4b-bea9-5c15207922ab tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71" returned: 0 in 0.382s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d7131b44-7544-4c4b-bea9-5c15207922ab tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:16 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71 Sep 10 20:01:16 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:16 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d7131b44-7544-4c4b-bea9-5c15207922ab tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-b142f958-d662-478f-9fdc-3fb8bc3a7b71" returned: 0 in 0.295s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d7131b44-7544-4c4b-bea9-5c15207922ab tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "cinder-quobyte-b142f958-d662-478f-9fdc-3fb8bc3a7b71" released by "delete_volume" :: held 0.737s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:16 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-d7131b44-7544-4c4b-bea9-5c15207922ab tempest-CreateVolumesFromSnapshotTest-61759576 None] Created reservations ['bf99af31-7aed-4315-862d-6bc57d93c526', '16a59cbd-d192-4edc-a3d0-70c9bd8ee164', '1513f3e5-ded7-4ec0-b3c3-24453115eccc', 'ebfc0910-5075-44e3-a861-6ff875de2ae5'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:01:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d7131b44-7544-4c4b-bea9-5c15207922ab tempest-CreateVolumesFromSnapshotTest-61759576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d7131b44-7544-4c4b-bea9-5c15207922ab tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:16 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d7131b44-7544-4c4b-bea9-5c15207922ab tempest-CreateVolumesFromSnapshotTest-61759576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:01:16 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d7131b44-7544-4c4b-bea9-5c15207922ab tempest-CreateVolumesFromSnapshotTest-61759576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:01:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d7131b44-7544-4c4b-bea9-5c15207922ab tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d7131b44-7544-4c4b-bea9-5c15207922ab tempest-CreateVolumesFromSnapshotTest-61759576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:16 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:01:16 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:16 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d7131b44-7544-4c4b-bea9-5c15207922ab tempest-CreateVolumesFromSnapshotTest-61759576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.242s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:16 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-d7131b44-7544-4c4b-bea9-5c15207922ab tempest-CreateVolumesFromSnapshotTest-61759576 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:01:16 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-d7131b44-7544-4c4b-bea9-5c15207922ab tempest-CreateVolumesFromSnapshotTest-61759576 None] Deleted volume successfully. Sep 10 20:01:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d7131b44-7544-4c4b-bea9-5c15207922ab tempest-CreateVolumesFromSnapshotTest-61759576 None] Lock "cinder-b142f958-d662-478f-9fdc-3fb8bc3a7b71-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:23 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:01:23 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Flow 'volume_create_manager' (f3e3386f-effc-4b2b-b11c-054b1392240f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:01:23 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d0694d-da39-40d5-8239-7beb15912ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:23 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d0694d-da39-40d5-8239-7beb15912ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b8565d-9064-4fd7-9c8a-f9ef14d87d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3a3a97f1164d38909654e172b96675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:01:24Z,use_quota=True,user_id='521c3c31949943fab133da09e03b73be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:23 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9220d275-5ba8-4303-b4bf-0a58c56256bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:23 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9220d275-5ba8-4303-b4bf-0a58c56256bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:23 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82eac6dc-8daa-4eda-a6f4-38b62518fe79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:23 devstack cinder-volume[88093]: DEBUG cinder.image.glance [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Creating Keystone auth plugin from conf {{(pid=88093) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 20:01:24 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82eac6dc-8daa-4eda-a6f4-38b62518fe79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c7b8565d-9064-4fd7-9c8a-f9ef14d87d99', 'volume_name': 'volume-c7b8565d-9064-4fd7-9c8a-f9ef14d87d99', 'volume_size': 1, 'image_id': '6898790b-7836-464d-8979-03369750388e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6898790b-7836-464d-8979-03369750388e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c86dfa8a3298bf88f415ea500f08a80c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1b3a3a97f1164d38909654e172b96675', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '14fa9a0876f6ef503a116b84624359c721ec21f565d97c5f039ce59619f450f5a2e0124ed6dbdf64b22565e6be9b49d7613f23bacd06cad33d04aae51ad89530', 'id': '6898790b-7836-464d-8979-03369750388e', 'created_at': datetime.datetime(2026, 9, 10, 18, 1, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 18, 1, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6898790b-7836-464d-8979-03369750388e/file', 'properties': {}}, 'image_service': }' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:24 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4be491-877e-4ec0-a6c4-a64f082d4eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:24 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4be491-877e-4ec0-a6c4-a64f082d4eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:24 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f7bf4ec-7548-4d4b-874e-a07ea9724a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:24 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Volume c7b8565d-9064-4fd7-9c8a-f9ef14d87d99: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c7b8565d-9064-4fd7-9c8a-f9ef14d87d99', 'volume_size': 1, 'image_id': '6898790b-7836-464d-8979-03369750388e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6898790b-7836-464d-8979-03369750388e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c86dfa8a3298bf88f415ea500f08a80c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1b3a3a97f1164d38909654e172b96675', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '14fa9a0876f6ef503a116b84624359c721ec21f565d97c5f039ce59619f450f5a2e0124ed6dbdf64b22565e6be9b49d7613f23bacd06cad33d04aae51ad89530', 'id': '6898790b-7836-464d-8979-03369750388e', 'created_at': datetime.datetime(2026, 9, 10, 18, 1, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 18, 1, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6898790b-7836-464d-8979-03369750388e/file', 'properties': {}}, 'image_service': } Sep 10 20:01:24 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Trying to clone c7b8565d-9064-4fd7-9c8a-f9ef14d87d99 from image 6898790b-7836-464d-8979-03369750388e at location (None, [{'url': 'file:///opt/stack/data/glance/images/6898790b-7836-464d-8979-03369750388e', 'metadata': {}}]). {{(pid=88093) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 20:01:24 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6898790b-7836-464d-8979-03369750388e_rpstkxefdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88093) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 20:01:24 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Image download 0.00 MB at 0.00 MB/s Sep 10 20:01:24 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[0376ea37-bfb0-4638-89e6-51a1847da668]: (4, 'raw') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:01:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6898790b-7836-464d-8979-03369750388e_rpstkxefdevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:24 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6898790b-7836-464d-8979-03369750388e_rpstkxefdevstack@QuobyteHD Sep 10 20:01:24 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:24 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6898790b-7836-464d-8979-03369750388e_rpstkxefdevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6898790b-7836-464d-8979-03369750388e_rpstkxefdevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:24 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6898790b-7836-464d-8979-03369750388e_rpstkxefdevstack@QuobyteHD Sep 10 20:01:24 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:25 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6898790b-7836-464d-8979-03369750388e_rpstkxefdevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6898790b-7836-464d-8979-03369750388e_rpstkxefdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:01:25 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Temporary image 6898790b-7836-464d-8979-03369750388e is fetched for user 521c3c31949943fab133da09e03b73be. {{(pid=88093) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 20:01:25 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9288f7d-0334-405d-8e37-a4a130704d7f]: (4, 'raw') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:01:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6898790b-7836-464d-8979-03369750388e_rpstkxefdevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:25 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6898790b-7836-464d-8979-03369750388e_rpstkxefdevstack@QuobyteHD Sep 10 20:01:25 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:25 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6898790b-7836-464d-8979-03369750388e_rpstkxefdevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6898790b-7836-464d-8979-03369750388e_rpstkxefdevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:25 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6898790b-7836-464d-8979-03369750388e_rpstkxefdevstack@QuobyteHD Sep 10 20:01:25 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:25 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6898790b-7836-464d-8979-03369750388e_rpstkxefdevstack@QuobyteHD" returned: 1 in 0.318s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6898790b-7836-464d-8979-03369750388e_rpstkxefdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:01:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:25 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b8565d-9064-4fd7-9c8a-f9ef14d87d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3a3a97f1164d38909654e172b96675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:01:24Z,use_quota=True,user_id='521c3c31949943fab133da09e03b73be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:01:25 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Creating volume c7b8565d-9064-4fd7-9c8a-f9ef14d87d99 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:01:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:25 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:01:25 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:01:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:25 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:01:25 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:01:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7b8565d-9064-4fd7-9c8a-f9ef14d87d99 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:25 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7b8565d-9064-4fd7-9c8a-f9ef14d87d99 1073741824 Sep 10 20:01:25 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:26 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7b8565d-9064-4fd7-9c8a-f9ef14d87d99 1073741824" returned: 0 in 0.430s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7b8565d-9064-4fd7-9c8a-f9ef14d87d99 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:26 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7b8565d-9064-4fd7-9c8a-f9ef14d87d99 Sep 10 20:01:26 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:26 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7b8565d-9064-4fd7-9c8a-f9ef14d87d99" returned: 0 in 0.245s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:26 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:01:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:26 devstack cinder-volume[88093]: DEBUG cinder.volume.volume_utils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Attempting download of 6898790b-7836-464d-8979-03369750388e ((None, [{'url': 'file:///opt/stack/data/glance/images/6898790b-7836-464d-8979-03369750388e', 'metadata': {}}])) to volume c7b8565d-9064-4fd7-9c8a-f9ef14d87d99. {{(pid=88093) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 20:01:26 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ef58a4-3239-4969-a9ed-f8a01b8ddcc0]: (4, 'raw') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:01:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6898790b-7836-464d-8979-03369750388e_m4dm8p3z {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:26 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6898790b-7836-464d-8979-03369750388e_m4dm8p3z Sep 10 20:01:26 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:26 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6898790b-7836-464d-8979-03369750388e_m4dm8p3z" returned: 0 in 0.346s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6898790b-7836-464d-8979-03369750388e_m4dm8p3z {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:27 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6898790b-7836-464d-8979-03369750388e_m4dm8p3z Sep 10 20:01:27 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:27 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6898790b-7836-464d-8979-03369750388e_m4dm8p3z" returned: 1 in 0.425s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6898790b-7836-464d-8979-03369750388e_m4dm8p3z' failed. Not Retrying. {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:01:27 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[942bfc28-5682-488b-af6b-6ce46a16a680]: (4, 'raw') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:01:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6898790b-7836-464d-8979-03369750388e_rpstkxefdevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:27 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6898790b-7836-464d-8979-03369750388e_rpstkxefdevstack@QuobyteHD Sep 10 20:01:27 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:27 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6898790b-7836-464d-8979-03369750388e_rpstkxefdevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6898790b-7836-464d-8979-03369750388e_rpstkxefdevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:27 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6898790b-7836-464d-8979-03369750388e_rpstkxefdevstack@QuobyteHD Sep 10 20:01:27 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:28 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6898790b-7836-464d-8979-03369750388e_rpstkxefdevstack@QuobyteHD" returned: 1 in 0.348s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6898790b-7836-464d-8979-03369750388e_rpstkxefdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:01:28 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] 6898790b-7836-464d-8979-03369750388e was raw, converting to qcow2 {{(pid=88093) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 20:01:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6898790b-7836-464d-8979-03369750388e_rpstkxefdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7b8565d-9064-4fd7-9c8a-f9ef14d87d99 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:28 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6898790b-7836-464d-8979-03369750388e_rpstkxefdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7b8565d-9064-4fd7-9c8a-f9ef14d87d99 Sep 10 20:01:28 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:28 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6898790b-7836-464d-8979-03369750388e_rpstkxefdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7b8565d-9064-4fd7-9c8a-f9ef14d87d99" returned: 0 in 0.448s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:28 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6898790b-7836-464d-8979-03369750388e_rpstkxefdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7b8565d-9064-4fd7-9c8a-f9ef14d87d99 {{(pid=88093) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 20:01:28 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Converted 0.00 MB image at 0.00 MB/s Sep 10 20:01:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7b8565d-9064-4fd7-9c8a-f9ef14d87d99 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:28 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7b8565d-9064-4fd7-9c8a-f9ef14d87d99 1G Sep 10 20:01:28 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:28 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7b8565d-9064-4fd7-9c8a-f9ef14d87d99 1G" returned: 0 in 0.302s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:28 devstack cinder-volume[88093]: DEBUG cinder.volume.volume_utils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Downloaded image 6898790b-7836-464d-8979-03369750388e ((None, [{'url': 'file:///opt/stack/data/glance/images/6898790b-7836-464d-8979-03369750388e', 'metadata': {}}])) to volume c7b8565d-9064-4fd7-9c8a-f9ef14d87d99 successfully. {{(pid=88093) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 20:01:28 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Temporary image 6898790b-7836-464d-8979-03369750388e for user 521c3c31949943fab133da09e03b73be is deleted. {{(pid=88093) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 20:01:28 devstack cinder-volume[88093]: DEBUG cinder.volume.volume_utils [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Marking volume c7b8565d-9064-4fd7-9c8a-f9ef14d87d99 as bootable. {{(pid=88093) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 20:01:28 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Copying metadata from image 6898790b-7836-464d-8979-03369750388e to c7b8565d-9064-4fd7-9c8a-f9ef14d87d99. {{(pid=88093) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 20:01:28 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Creating volume glance metadata for volume c7b8565d-9064-4fd7-9c8a-f9ef14d87d99 backed by image 6898790b-7836-464d-8979-03369750388e with: {'image_id': '6898790b-7836-464d-8979-03369750388e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c86dfa8a3298bf88f415ea500f08a80c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88093) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 20:01:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f7bf4ec-7548-4d4b-874e-a07ea9724a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7b8565d-9064-4fd7-9c8a-f9ef14d87d99', 'volume_size': 1, 'image_id': '6898790b-7836-464d-8979-03369750388e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6898790b-7836-464d-8979-03369750388e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c86dfa8a3298bf88f415ea500f08a80c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1b3a3a97f1164d38909654e172b96675', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '14fa9a0876f6ef503a116b84624359c721ec21f565d97c5f039ce59619f450f5a2e0124ed6dbdf64b22565e6be9b49d7613f23bacd06cad33d04aae51ad89530', 'id': '6898790b-7836-464d-8979-03369750388e', 'created_at': datetime.datetime(2026, 9, 10, 18, 1, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 18, 1, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6898790b-7836-464d-8979-03369750388e/file', 'properties': {}}, 'image_service': }' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbf004ef-be26-4a25-8594-1af198268127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:28 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Volume volume-c7b8565d-9064-4fd7-9c8a-f9ef14d87d99 (c7b8565d-9064-4fd7-9c8a-f9ef14d87d99): created successfully Sep 10 20:01:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbf004ef-be26-4a25-8594-1af198268127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Flow 'volume_create_manager' (f3e3386f-effc-4b2b-b11c-054b1392240f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:01:28 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-7b494a0c-d7c0-4360-9c21-9e5beb2b785f tempest-VolumeImageDependencyTests-1606055100 None] Created volume successfully. Sep 10 20:01:29 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2be74768-c9d7-4b32-b7ba-ae3ad0b32cb2 tempest-VolumeImageDependencyTests-1606055100 None] Acquiring lock "cinder-c7b8565d-9064-4fd7-9c8a-f9ef14d87d99-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:29 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2be74768-c9d7-4b32-b7ba-ae3ad0b32cb2 tempest-VolumeImageDependencyTests-1606055100 None] Lock "cinder-c7b8565d-9064-4fd7-9c8a-f9ef14d87d99-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:29 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2be74768-c9d7-4b32-b7ba-ae3ad0b32cb2 tempest-VolumeImageDependencyTests-1606055100 None] Acquiring lock "cinder-quobyte-c7b8565d-9064-4fd7-9c8a-f9ef14d87d99" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:29 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2be74768-c9d7-4b32-b7ba-ae3ad0b32cb2 tempest-VolumeImageDependencyTests-1606055100 None] Lock "cinder-quobyte-c7b8565d-9064-4fd7-9c8a-f9ef14d87d99" acquired by "delete_volume" :: waited 0.014s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:29 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd73ffc-3a78-4a63-a501-4c42247d6ff2]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:01:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2be74768-c9d7-4b32-b7ba-ae3ad0b32cb2 tempest-VolumeImageDependencyTests-1606055100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7b8565d-9064-4fd7-9c8a-f9ef14d87d99 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:29 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7b8565d-9064-4fd7-9c8a-f9ef14d87d99 Sep 10 20:01:29 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:29 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2be74768-c9d7-4b32-b7ba-ae3ad0b32cb2 tempest-VolumeImageDependencyTests-1606055100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7b8565d-9064-4fd7-9c8a-f9ef14d87d99" returned: 0 in 0.370s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2be74768-c9d7-4b32-b7ba-ae3ad0b32cb2 tempest-VolumeImageDependencyTests-1606055100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7b8565d-9064-4fd7-9c8a-f9ef14d87d99 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:29 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7b8565d-9064-4fd7-9c8a-f9ef14d87d99 Sep 10 20:01:29 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:29 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2be74768-c9d7-4b32-b7ba-ae3ad0b32cb2 tempest-VolumeImageDependencyTests-1606055100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c7b8565d-9064-4fd7-9c8a-f9ef14d87d99" returned: 0 in 0.259s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:29 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2be74768-c9d7-4b32-b7ba-ae3ad0b32cb2 tempest-VolumeImageDependencyTests-1606055100 None] Lock "cinder-quobyte-c7b8565d-9064-4fd7-9c8a-f9ef14d87d99" released by "delete_volume" :: held 0.671s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:30 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-2be74768-c9d7-4b32-b7ba-ae3ad0b32cb2 tempest-VolumeImageDependencyTests-1606055100 None] Created reservations ['771b19f0-89e7-4742-9e93-9b46e20a48e8', '07800e68-12e4-4339-826d-73e264844299', 'd0c8ff94-90e4-45df-bc72-178409e5c766', '904c7226-1fef-4680-9a6f-8ae398023969'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:01:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2be74768-c9d7-4b32-b7ba-ae3ad0b32cb2 tempest-VolumeImageDependencyTests-1606055100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2be74768-c9d7-4b32-b7ba-ae3ad0b32cb2 tempest-VolumeImageDependencyTests-1606055100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:30 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2be74768-c9d7-4b32-b7ba-ae3ad0b32cb2 tempest-VolumeImageDependencyTests-1606055100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:01:30 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2be74768-c9d7-4b32-b7ba-ae3ad0b32cb2 tempest-VolumeImageDependencyTests-1606055100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:01:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2be74768-c9d7-4b32-b7ba-ae3ad0b32cb2 tempest-VolumeImageDependencyTests-1606055100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2be74768-c9d7-4b32-b7ba-ae3ad0b32cb2 tempest-VolumeImageDependencyTests-1606055100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:30 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:01:30 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:30 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2be74768-c9d7-4b32-b7ba-ae3ad0b32cb2 tempest-VolumeImageDependencyTests-1606055100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.243s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:30 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-2be74768-c9d7-4b32-b7ba-ae3ad0b32cb2 tempest-VolumeImageDependencyTests-1606055100 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:01:30 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-2be74768-c9d7-4b32-b7ba-ae3ad0b32cb2 tempest-VolumeImageDependencyTests-1606055100 None] Deleted volume successfully. Sep 10 20:01:30 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2be74768-c9d7-4b32-b7ba-ae3ad0b32cb2 tempest-VolumeImageDependencyTests-1606055100 None] Lock "cinder-c7b8565d-9064-4fd7-9c8a-f9ef14d87d99-delete_volume" released by "delete_volume" :: held 1.120s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:33 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:01:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] Flow 'volume_create_manager' (6ce0c64c-de44-46b1-847e-630b1c9e4d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:01:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd5f7481-b384-422f-b997-b4b5f57e3732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd5f7481-b384-422f-b997-b4b5f57e3732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1141013830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e57f356a-0209-4dec-82cf-23fa6a7fe953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38cde6a1be4746879e37cbfe5081110e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:01:34Z,use_quota=True,user_id='fef8d22fcf684196b70e4e254e4a814c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (232501ec-0f57-45f8-956f-b493a6a144d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (232501ec-0f57-45f8-956f-b493a6a144d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97d55ae-510d-424b-8e6d-32b2bec7fff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97d55ae-510d-424b-8e6d-32b2bec7fff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e57f356a-0209-4dec-82cf-23fa6a7fe953', 'volume_name': 'volume-e57f356a-0209-4dec-82cf-23fa6a7fe953', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (771ae569-6d94-4e67-a01b-7292a1e01367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (771ae569-6d94-4e67-a01b-7292a1e01367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (768c70c1-57aa-4cd1-b799-c740320bff1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:34 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] Volume e57f356a-0209-4dec-82cf-23fa6a7fe953: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e57f356a-0209-4dec-82cf-23fa6a7fe953', 'volume_size': 1} Sep 10 20:01:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:34 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1141013830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e57f356a-0209-4dec-82cf-23fa6a7fe953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38cde6a1be4746879e37cbfe5081110e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:01:34Z,use_quota=True,user_id='fef8d22fcf684196b70e4e254e4a814c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:01:34 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] Creating volume e57f356a-0209-4dec-82cf-23fa6a7fe953 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:01:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:34 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:01:34 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:01:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:34 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:01:34 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:01:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e57f356a-0209-4dec-82cf-23fa6a7fe953 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:34 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e57f356a-0209-4dec-82cf-23fa6a7fe953 1073741824 Sep 10 20:01:34 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:34 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e57f356a-0209-4dec-82cf-23fa6a7fe953 1073741824" returned: 0 in 0.421s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e57f356a-0209-4dec-82cf-23fa6a7fe953 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:34 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e57f356a-0209-4dec-82cf-23fa6a7fe953 Sep 10 20:01:34 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:34 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e57f356a-0209-4dec-82cf-23fa6a7fe953" returned: 0 in 0.254s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:34 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:01:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (768c70c1-57aa-4cd1-b799-c740320bff1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e57f356a-0209-4dec-82cf-23fa6a7fe953', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d6b96e-a7b5-426f-b8e9-306b75a7cfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:34 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] Volume volume-e57f356a-0209-4dec-82cf-23fa6a7fe953 (e57f356a-0209-4dec-82cf-23fa6a7fe953): created successfully Sep 10 20:01:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d6b96e-a7b5-426f-b8e9-306b75a7cfd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] Flow 'volume_create_manager' (6ce0c64c-de44-46b1-847e-630b1c9e4d11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:01:34 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-dbb0a6ba-8b3b-43f8-84dc-edb9328058c1 tempest-ProjectReaderTests-1394178744 None] Created volume successfully. Sep 10 20:01:35 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-10b768be-8649-4ea8-8d31-f43c29e338be tempest-ProjectReaderTests-1394178744 None] Acquiring lock "cinder-e57f356a-0209-4dec-82cf-23fa6a7fe953-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:35 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-10b768be-8649-4ea8-8d31-f43c29e338be tempest-ProjectReaderTests-1394178744 None] Lock "cinder-e57f356a-0209-4dec-82cf-23fa6a7fe953-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:35 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-10b768be-8649-4ea8-8d31-f43c29e338be tempest-ProjectReaderTests-1394178744 None] Acquiring lock "cinder-quobyte-e57f356a-0209-4dec-82cf-23fa6a7fe953" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:35 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-10b768be-8649-4ea8-8d31-f43c29e338be tempest-ProjectReaderTests-1394178744 None] Lock "cinder-quobyte-e57f356a-0209-4dec-82cf-23fa6a7fe953" acquired by "delete_volume" :: waited 0.014s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:35 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c72081-8903-4d6a-a7b3-c2b885be7c4c]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:01:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-10b768be-8649-4ea8-8d31-f43c29e338be tempest-ProjectReaderTests-1394178744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e57f356a-0209-4dec-82cf-23fa6a7fe953 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:35 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e57f356a-0209-4dec-82cf-23fa6a7fe953 Sep 10 20:01:35 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:35 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-10b768be-8649-4ea8-8d31-f43c29e338be tempest-ProjectReaderTests-1394178744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e57f356a-0209-4dec-82cf-23fa6a7fe953" returned: 0 in 0.386s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-10b768be-8649-4ea8-8d31-f43c29e338be tempest-ProjectReaderTests-1394178744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e57f356a-0209-4dec-82cf-23fa6a7fe953 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:35 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e57f356a-0209-4dec-82cf-23fa6a7fe953 Sep 10 20:01:35 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:35 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-10b768be-8649-4ea8-8d31-f43c29e338be tempest-ProjectReaderTests-1394178744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e57f356a-0209-4dec-82cf-23fa6a7fe953" returned: 0 in 0.272s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:35 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-10b768be-8649-4ea8-8d31-f43c29e338be tempest-ProjectReaderTests-1394178744 None] Lock "cinder-quobyte-e57f356a-0209-4dec-82cf-23fa6a7fe953" released by "delete_volume" :: held 0.695s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-10b768be-8649-4ea8-8d31-f43c29e338be tempest-ProjectReaderTests-1394178744 None] Created reservations ['d3a7617e-c7c8-4576-9261-921fc114e55d', '9c7fcc24-2b81-4b8f-876f-5aeceb4e8abb', 'c5a839a0-87ab-49cd-aee6-ae75a6ccbd2c', 'e8d5f928-13b2-40b9-ba75-8c30ef6ecfda'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-10b768be-8649-4ea8-8d31-f43c29e338be tempest-ProjectReaderTests-1394178744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-10b768be-8649-4ea8-8d31-f43c29e338be tempest-ProjectReaderTests-1394178744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-10b768be-8649-4ea8-8d31-f43c29e338be tempest-ProjectReaderTests-1394178744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-10b768be-8649-4ea8-8d31-f43c29e338be tempest-ProjectReaderTests-1394178744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-10b768be-8649-4ea8-8d31-f43c29e338be tempest-ProjectReaderTests-1394178744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-10b768be-8649-4ea8-8d31-f43c29e338be tempest-ProjectReaderTests-1394178744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:36 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:01:36 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:36 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-10b768be-8649-4ea8-8d31-f43c29e338be tempest-ProjectReaderTests-1394178744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.240s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-10b768be-8649-4ea8-8d31-f43c29e338be tempest-ProjectReaderTests-1394178744 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:01:36 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-10b768be-8649-4ea8-8d31-f43c29e338be tempest-ProjectReaderTests-1394178744 None] Deleted volume successfully. Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-10b768be-8649-4ea8-8d31-f43c29e338be tempest-ProjectReaderTests-1394178744 None] Lock "cinder-e57f356a-0209-4dec-82cf-23fa6a7fe953-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] Flow 'volume_create_manager' (032186e8-3d52-47ed-9a68-5bc0d961f7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0cc4f97-25ac-4a6f-933d-434ffe9211de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0cc4f97-25ac-4a6f-933d-434ffe9211de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1655402476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=023007f3-53a0-42e2-bf6d-9c088fa8b66a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38cde6a1be4746879e37cbfe5081110e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:01:37Z,use_quota=True,user_id='fef8d22fcf684196b70e4e254e4a814c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfec1dd5-28e0-4ee5-bc65-81a400f189b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfec1dd5-28e0-4ee5-bc65-81a400f189b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc53f3f-67d6-4cb6-a02d-61cc0dd17652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc53f3f-67d6-4cb6-a02d-61cc0dd17652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '023007f3-53a0-42e2-bf6d-9c088fa8b66a', 'volume_name': 'volume-023007f3-53a0-42e2-bf6d-9c088fa8b66a', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c61b322-f740-421e-95bf-71655969fe7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c61b322-f740-421e-95bf-71655969fe7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d29836-672a-49f9-9be5-4bc371436fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:36 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] Volume 023007f3-53a0-42e2-bf6d-9c088fa8b66a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-023007f3-53a0-42e2-bf6d-9c088fa8b66a', 'volume_size': 1} Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1655402476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=023007f3-53a0-42e2-bf6d-9c088fa8b66a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38cde6a1be4746879e37cbfe5081110e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:01:37Z,use_quota=True,user_id='fef8d22fcf684196b70e4e254e4a814c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] Creating volume 023007f3-53a0-42e2-bf6d-9c088fa8b66a {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:01:36 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:01:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-023007f3-53a0-42e2-bf6d-9c088fa8b66a 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:36 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-023007f3-53a0-42e2-bf6d-9c088fa8b66a 1073741824 Sep 10 20:01:36 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:37 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-023007f3-53a0-42e2-bf6d-9c088fa8b66a 1073741824" returned: 0 in 0.423s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-023007f3-53a0-42e2-bf6d-9c088fa8b66a {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:37 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-023007f3-53a0-42e2-bf6d-9c088fa8b66a Sep 10 20:01:37 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:37 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-023007f3-53a0-42e2-bf6d-9c088fa8b66a" returned: 0 in 0.240s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:37 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:01:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d29836-672a-49f9-9be5-4bc371436fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-023007f3-53a0-42e2-bf6d-9c088fa8b66a', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ee88b24-5aca-4b32-b211-5b36b0e4ea90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:37 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] Volume volume-023007f3-53a0-42e2-bf6d-9c088fa8b66a (023007f3-53a0-42e2-bf6d-9c088fa8b66a): created successfully Sep 10 20:01:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ee88b24-5aca-4b32-b211-5b36b0e4ea90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] Flow 'volume_create_manager' (032186e8-3d52-47ed-9a68-5bc0d961f7f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:01:37 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-a60989a8-510b-46c4-aa50-ee100688a345 tempest-ProjectReaderTests-1394178744 None] Created volume successfully. Sep 10 20:01:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-03c0fca0-b464-4275-9012-049fdd812feb tempest-ProjectReaderTests-1394178744 None] Acquiring lock "cinder-023007f3-53a0-42e2-bf6d-9c088fa8b66a-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-03c0fca0-b464-4275-9012-049fdd812feb tempest-ProjectReaderTests-1394178744 None] Lock "cinder-023007f3-53a0-42e2-bf6d-9c088fa8b66a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-03c0fca0-b464-4275-9012-049fdd812feb tempest-ProjectReaderTests-1394178744 None] Acquiring lock "cinder-quobyte-023007f3-53a0-42e2-bf6d-9c088fa8b66a" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-03c0fca0-b464-4275-9012-049fdd812feb tempest-ProjectReaderTests-1394178744 None] Lock "cinder-quobyte-023007f3-53a0-42e2-bf6d-9c088fa8b66a" acquired by "delete_volume" :: waited 0.016s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:37 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5e8613-4b3c-46dc-b8e0-8649c859d4c5]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:01:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-03c0fca0-b464-4275-9012-049fdd812feb tempest-ProjectReaderTests-1394178744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-023007f3-53a0-42e2-bf6d-9c088fa8b66a {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:38 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-023007f3-53a0-42e2-bf6d-9c088fa8b66a Sep 10 20:01:38 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:38 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-03c0fca0-b464-4275-9012-049fdd812feb tempest-ProjectReaderTests-1394178744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-023007f3-53a0-42e2-bf6d-9c088fa8b66a" returned: 0 in 0.361s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-03c0fca0-b464-4275-9012-049fdd812feb tempest-ProjectReaderTests-1394178744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-023007f3-53a0-42e2-bf6d-9c088fa8b66a {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:38 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-023007f3-53a0-42e2-bf6d-9c088fa8b66a Sep 10 20:01:38 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:38 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-03c0fca0-b464-4275-9012-049fdd812feb tempest-ProjectReaderTests-1394178744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-023007f3-53a0-42e2-bf6d-9c088fa8b66a" returned: 0 in 0.250s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-03c0fca0-b464-4275-9012-049fdd812feb tempest-ProjectReaderTests-1394178744 None] Lock "cinder-quobyte-023007f3-53a0-42e2-bf6d-9c088fa8b66a" released by "delete_volume" :: held 0.647s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:38 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-03c0fca0-b464-4275-9012-049fdd812feb tempest-ProjectReaderTests-1394178744 None] Created reservations ['34a15c4e-4b80-4374-9a05-0f92ad52e913', '025b067d-274e-410e-9437-39fa995af35a', 'd0d2cac3-a367-4780-b1ac-70d9aac6e0e2', '7ebc693f-302a-4732-a193-f60c4e8ff8f4'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:01:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-03c0fca0-b464-4275-9012-049fdd812feb tempest-ProjectReaderTests-1394178744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-03c0fca0-b464-4275-9012-049fdd812feb tempest-ProjectReaderTests-1394178744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:38 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-03c0fca0-b464-4275-9012-049fdd812feb tempest-ProjectReaderTests-1394178744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:01:38 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-03c0fca0-b464-4275-9012-049fdd812feb tempest-ProjectReaderTests-1394178744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:01:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-03c0fca0-b464-4275-9012-049fdd812feb tempest-ProjectReaderTests-1394178744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-03c0fca0-b464-4275-9012-049fdd812feb tempest-ProjectReaderTests-1394178744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:38 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:01:38 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:38 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-03c0fca0-b464-4275-9012-049fdd812feb tempest-ProjectReaderTests-1394178744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.248s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:38 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-03c0fca0-b464-4275-9012-049fdd812feb tempest-ProjectReaderTests-1394178744 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:01:38 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-03c0fca0-b464-4275-9012-049fdd812feb tempest-ProjectReaderTests-1394178744 None] Deleted volume successfully. Sep 10 20:01:39 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-03c0fca0-b464-4275-9012-049fdd812feb tempest-ProjectReaderTests-1394178744 None] Lock "cinder-023007f3-53a0-42e2-bf6d-9c088fa8b66a-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:43 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:01:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] Flow 'volume_create_manager' (069403ad-0ef8-4f25-966d-de47b0737448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:01:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29ee1021-3c28-4055-926a-9110701c01c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29ee1021-3c28-4055-926a-9110701c01c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2141583088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e824bb90-4095-499c-8929-dcbd68d4553a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b6f8fe22af4459d8670339c32ca3558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:01:43Z,use_quota=True,user_id='958b2bb7426549f6a54582f36f193888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8961965-7a6c-442c-82dc-b8827afa6741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8961965-7a6c-442c-82dc-b8827afa6741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73326dfe-6084-4fa3-83a4-c788b1b84c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73326dfe-6084-4fa3-83a4-c788b1b84c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e824bb90-4095-499c-8929-dcbd68d4553a', 'volume_name': 'volume-e824bb90-4095-499c-8929-dcbd68d4553a', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac18c8e9-fac2-44d3-85f1-a78fa5e0f899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac18c8e9-fac2-44d3-85f1-a78fa5e0f899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7d90341-5539-471f-983f-b9c08cc722b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:43 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] Volume e824bb90-4095-499c-8929-dcbd68d4553a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e824bb90-4095-499c-8929-dcbd68d4553a', 'volume_size': 1} Sep 10 20:01:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2141583088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e824bb90-4095-499c-8929-dcbd68d4553a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b6f8fe22af4459d8670339c32ca3558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:01:43Z,use_quota=True,user_id='958b2bb7426549f6a54582f36f193888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:01:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] Creating volume e824bb90-4095-499c-8929-dcbd68d4553a {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:01:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:01:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:01:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:01:43 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:01:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e824bb90-4095-499c-8929-dcbd68d4553a 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:43 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e824bb90-4095-499c-8929-dcbd68d4553a 1073741824 Sep 10 20:01:43 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:43 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e824bb90-4095-499c-8929-dcbd68d4553a 1073741824" returned: 0 in 0.404s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e824bb90-4095-499c-8929-dcbd68d4553a {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:43 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e824bb90-4095-499c-8929-dcbd68d4553a Sep 10 20:01:43 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:43 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e824bb90-4095-499c-8929-dcbd68d4553a" returned: 0 in 0.272s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:01:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7d90341-5539-471f-983f-b9c08cc722b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e824bb90-4095-499c-8929-dcbd68d4553a', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3577c80-51c1-4541-afb0-78dc8a0f4804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:43 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] Volume volume-e824bb90-4095-499c-8929-dcbd68d4553a (e824bb90-4095-499c-8929-dcbd68d4553a): created successfully Sep 10 20:01:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3577c80-51c1-4541-afb0-78dc8a0f4804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] Flow 'volume_create_manager' (069403ad-0ef8-4f25-966d-de47b0737448) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:01:43 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-586eec23-6404-4e0d-8768-b9c438af4118 tempest-ProjectReaderTests-814147704 None] Created volume successfully. Sep 10 20:01:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7f15f195-2843-4e73-ab7b-47ba9cfdb3f9 tempest-ProjectReaderTests-814147704 None] Acquiring lock "cinder-e824bb90-4095-499c-8929-dcbd68d4553a-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7f15f195-2843-4e73-ab7b-47ba9cfdb3f9 tempest-ProjectReaderTests-814147704 None] Lock "cinder-e824bb90-4095-499c-8929-dcbd68d4553a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7f15f195-2843-4e73-ab7b-47ba9cfdb3f9 tempest-ProjectReaderTests-814147704 None] Acquiring lock "cinder-quobyte-e824bb90-4095-499c-8929-dcbd68d4553a" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7f15f195-2843-4e73-ab7b-47ba9cfdb3f9 tempest-ProjectReaderTests-814147704 None] Lock "cinder-quobyte-e824bb90-4095-499c-8929-dcbd68d4553a" acquired by "delete_volume" :: waited 0.016s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:44 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ee8c23-14fb-4dfd-a2cb-cb732a6d6c22]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:01:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7f15f195-2843-4e73-ab7b-47ba9cfdb3f9 tempest-ProjectReaderTests-814147704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e824bb90-4095-499c-8929-dcbd68d4553a {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:44 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e824bb90-4095-499c-8929-dcbd68d4553a Sep 10 20:01:44 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:44 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7f15f195-2843-4e73-ab7b-47ba9cfdb3f9 tempest-ProjectReaderTests-814147704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e824bb90-4095-499c-8929-dcbd68d4553a" returned: 0 in 0.352s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7f15f195-2843-4e73-ab7b-47ba9cfdb3f9 tempest-ProjectReaderTests-814147704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e824bb90-4095-499c-8929-dcbd68d4553a {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:44 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e824bb90-4095-499c-8929-dcbd68d4553a Sep 10 20:01:44 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:44 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7f15f195-2843-4e73-ab7b-47ba9cfdb3f9 tempest-ProjectReaderTests-814147704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e824bb90-4095-499c-8929-dcbd68d4553a" returned: 0 in 0.254s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7f15f195-2843-4e73-ab7b-47ba9cfdb3f9 tempest-ProjectReaderTests-814147704 None] Lock "cinder-quobyte-e824bb90-4095-499c-8929-dcbd68d4553a" released by "delete_volume" :: held 0.644s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:44 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-7f15f195-2843-4e73-ab7b-47ba9cfdb3f9 tempest-ProjectReaderTests-814147704 None] Created reservations ['31fd54e4-e7c7-4bd6-986a-d520d5783765', '48b60be0-5459-4bde-9d6c-e88ceb87f59e', '73d2746e-9f41-45d3-825c-a77232c42edf', 'b0ecee6b-16e8-4949-8101-8101eabe9193'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:01:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7f15f195-2843-4e73-ab7b-47ba9cfdb3f9 tempest-ProjectReaderTests-814147704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7f15f195-2843-4e73-ab7b-47ba9cfdb3f9 tempest-ProjectReaderTests-814147704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7f15f195-2843-4e73-ab7b-47ba9cfdb3f9 tempest-ProjectReaderTests-814147704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:01:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7f15f195-2843-4e73-ab7b-47ba9cfdb3f9 tempest-ProjectReaderTests-814147704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:01:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7f15f195-2843-4e73-ab7b-47ba9cfdb3f9 tempest-ProjectReaderTests-814147704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7f15f195-2843-4e73-ab7b-47ba9cfdb3f9 tempest-ProjectReaderTests-814147704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:45 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:01:45 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:45 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7f15f195-2843-4e73-ab7b-47ba9cfdb3f9 tempest-ProjectReaderTests-814147704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.272s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:45 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-7f15f195-2843-4e73-ab7b-47ba9cfdb3f9 tempest-ProjectReaderTests-814147704 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:01:45 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-7f15f195-2843-4e73-ab7b-47ba9cfdb3f9 tempest-ProjectReaderTests-814147704 None] Deleted volume successfully. Sep 10 20:01:45 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7f15f195-2843-4e73-ab7b-47ba9cfdb3f9 tempest-ProjectReaderTests-814147704 None] Lock "cinder-e824bb90-4095-499c-8929-dcbd68d4553a-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:45 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:01:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] Flow 'volume_create_manager' (422b2b70-4c05-4367-af11-ca59db3bce94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:01:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961efcbc-0b72-485a-b9a4-8f761c84bbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961efcbc-0b72-485a-b9a4-8f761c84bbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1366298008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f2075e-656a-44a7-ac96-7178f9054e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b6f8fe22af4459d8670339c32ca3558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:01:46Z,use_quota=True,user_id='958b2bb7426549f6a54582f36f193888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (574d5ef6-567c-4510-a30a-d28386393e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (574d5ef6-567c-4510-a30a-d28386393e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e9a918-826c-4e08-968a-9e6115989946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e9a918-826c-4e08-968a-9e6115989946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25f2075e-656a-44a7-ac96-7178f9054e94', 'volume_name': 'volume-25f2075e-656a-44a7-ac96-7178f9054e94', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6febbc29-c33a-4a00-87f0-be399c4d2487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6febbc29-c33a-4a00-87f0-be399c4d2487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e16cba18-36de-44a1-8fcc-34f417516cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:45 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] Volume 25f2075e-656a-44a7-ac96-7178f9054e94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25f2075e-656a-44a7-ac96-7178f9054e94', 'volume_size': 1} Sep 10 20:01:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1366298008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f2075e-656a-44a7-ac96-7178f9054e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b6f8fe22af4459d8670339c32ca3558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:01:46Z,use_quota=True,user_id='958b2bb7426549f6a54582f36f193888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:01:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] Creating volume 25f2075e-656a-44a7-ac96-7178f9054e94 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:01:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:01:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:01:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:01:45 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:01:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25f2075e-656a-44a7-ac96-7178f9054e94 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:45 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25f2075e-656a-44a7-ac96-7178f9054e94 1073741824 Sep 10 20:01:45 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:46 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25f2075e-656a-44a7-ac96-7178f9054e94 1073741824" returned: 0 in 0.420s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25f2075e-656a-44a7-ac96-7178f9054e94 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:46 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25f2075e-656a-44a7-ac96-7178f9054e94 Sep 10 20:01:46 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:46 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25f2075e-656a-44a7-ac96-7178f9054e94" returned: 0 in 0.247s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:46 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:01:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:46 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:INSERT=58,cinder:UPDATE=199,cinder:SELECT=132,cinder:DELETE=22 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:01:46 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e16cba18-36de-44a1-8fcc-34f417516cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25f2075e-656a-44a7-ac96-7178f9054e94', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:46 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c92ad3-01a7-46fb-9b09-a6307c781920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:46 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] Volume volume-25f2075e-656a-44a7-ac96-7178f9054e94 (25f2075e-656a-44a7-ac96-7178f9054e94): created successfully Sep 10 20:01:46 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c92ad3-01a7-46fb-9b09-a6307c781920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:46 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] Flow 'volume_create_manager' (422b2b70-4c05-4367-af11-ca59db3bce94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:01:46 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-0ad02831-2ecc-4365-8839-082e9e628f38 tempest-ProjectReaderTests-814147704 None] Created volume successfully. Sep 10 20:01:46 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c79eb6ae-f396-4058-9325-a9abdc08ca84 tempest-ProjectReaderTests-814147704 None] Acquiring lock "cinder-25f2075e-656a-44a7-ac96-7178f9054e94-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:46 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c79eb6ae-f396-4058-9325-a9abdc08ca84 tempest-ProjectReaderTests-814147704 None] Lock "cinder-25f2075e-656a-44a7-ac96-7178f9054e94-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:46 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c79eb6ae-f396-4058-9325-a9abdc08ca84 tempest-ProjectReaderTests-814147704 None] Acquiring lock "cinder-quobyte-25f2075e-656a-44a7-ac96-7178f9054e94" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:46 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c79eb6ae-f396-4058-9325-a9abdc08ca84 tempest-ProjectReaderTests-814147704 None] Lock "cinder-quobyte-25f2075e-656a-44a7-ac96-7178f9054e94" acquired by "delete_volume" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:46 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25ee81b-0b32-4548-8ed5-4b25eb2bf39a]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:01:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c79eb6ae-f396-4058-9325-a9abdc08ca84 tempest-ProjectReaderTests-814147704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25f2075e-656a-44a7-ac96-7178f9054e94 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:47 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25f2075e-656a-44a7-ac96-7178f9054e94 Sep 10 20:01:47 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:47 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c79eb6ae-f396-4058-9325-a9abdc08ca84 tempest-ProjectReaderTests-814147704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25f2075e-656a-44a7-ac96-7178f9054e94" returned: 0 in 0.360s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c79eb6ae-f396-4058-9325-a9abdc08ca84 tempest-ProjectReaderTests-814147704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25f2075e-656a-44a7-ac96-7178f9054e94 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:47 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25f2075e-656a-44a7-ac96-7178f9054e94 Sep 10 20:01:47 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:47 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c79eb6ae-f396-4058-9325-a9abdc08ca84 tempest-ProjectReaderTests-814147704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25f2075e-656a-44a7-ac96-7178f9054e94" returned: 0 in 0.252s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:47 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c79eb6ae-f396-4058-9325-a9abdc08ca84 tempest-ProjectReaderTests-814147704 None] Lock "cinder-quobyte-25f2075e-656a-44a7-ac96-7178f9054e94" released by "delete_volume" :: held 0.647s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:47 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-c79eb6ae-f396-4058-9325-a9abdc08ca84 tempest-ProjectReaderTests-814147704 None] Created reservations ['3ead8f3b-56e6-429e-a651-a460fa8c507e', 'b5364dde-0fc7-4a64-a17c-9f34b5275338', '4d4b0753-473c-4db8-a368-e5d767d2b854', 'e9f89e89-dfd9-4047-9d9a-1421c071897a'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:01:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c79eb6ae-f396-4058-9325-a9abdc08ca84 tempest-ProjectReaderTests-814147704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c79eb6ae-f396-4058-9325-a9abdc08ca84 tempest-ProjectReaderTests-814147704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:47 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c79eb6ae-f396-4058-9325-a9abdc08ca84 tempest-ProjectReaderTests-814147704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:01:47 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c79eb6ae-f396-4058-9325-a9abdc08ca84 tempest-ProjectReaderTests-814147704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:01:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c79eb6ae-f396-4058-9325-a9abdc08ca84 tempest-ProjectReaderTests-814147704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c79eb6ae-f396-4058-9325-a9abdc08ca84 tempest-ProjectReaderTests-814147704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:47 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:01:47 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:47 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c79eb6ae-f396-4058-9325-a9abdc08ca84 tempest-ProjectReaderTests-814147704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.237s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:47 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-c79eb6ae-f396-4058-9325-a9abdc08ca84 tempest-ProjectReaderTests-814147704 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:01:47 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-c79eb6ae-f396-4058-9325-a9abdc08ca84 tempest-ProjectReaderTests-814147704 None] Deleted volume successfully. Sep 10 20:01:47 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c79eb6ae-f396-4058-9325-a9abdc08ca84 tempest-ProjectReaderTests-814147704 None] Lock "cinder-25f2075e-656a-44a7-ac96-7178f9054e94-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:48 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:01:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] Flow 'volume_create_manager' (6c82de9c-09b4-4742-a3e5-5871577547d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:01:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (840a1b25-47df-4c5a-a2dc-db0ab63ae5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (840a1b25-47df-4c5a-a2dc-db0ab63ae5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1910790049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25703acc-8103-4aad-8915-f89fea292c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b6f8fe22af4459d8670339c32ca3558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:01:48Z,use_quota=True,user_id='958b2bb7426549f6a54582f36f193888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01221e66-a18e-464d-8680-1e66c7c28f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01221e66-a18e-464d-8680-1e66c7c28f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf791f43-f3d8-45b2-bb8e-2b3bc37145a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf791f43-f3d8-45b2-bb8e-2b3bc37145a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25703acc-8103-4aad-8915-f89fea292c3f', 'volume_name': 'volume-25703acc-8103-4aad-8915-f89fea292c3f', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f312142-a0cf-4617-adb8-d8575bc54d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f312142-a0cf-4617-adb8-d8575bc54d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:48 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad1fc2e8-ad08-48b8-b922-827eff7a529c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:48 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] Volume 25703acc-8103-4aad-8915-f89fea292c3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25703acc-8103-4aad-8915-f89fea292c3f', 'volume_size': 1} Sep 10 20:01:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:48 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1910790049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25703acc-8103-4aad-8915-f89fea292c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b6f8fe22af4459d8670339c32ca3558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:01:48Z,use_quota=True,user_id='958b2bb7426549f6a54582f36f193888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:01:48 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] Creating volume 25703acc-8103-4aad-8915-f89fea292c3f {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:01:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:48 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:01:48 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:01:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:48 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:01:48 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:01:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25703acc-8103-4aad-8915-f89fea292c3f 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:48 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25703acc-8103-4aad-8915-f89fea292c3f 1073741824 Sep 10 20:01:48 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:49 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25703acc-8103-4aad-8915-f89fea292c3f 1073741824" returned: 0 in 0.441s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25703acc-8103-4aad-8915-f89fea292c3f {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:49 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25703acc-8103-4aad-8915-f89fea292c3f Sep 10 20:01:49 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:49 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25703acc-8103-4aad-8915-f89fea292c3f" returned: 0 in 0.306s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:01:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad1fc2e8-ad08-48b8-b922-827eff7a529c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25703acc-8103-4aad-8915-f89fea292c3f', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cf46523-f7eb-44d7-b289-8639e43f333c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:49 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] Volume volume-25703acc-8103-4aad-8915-f89fea292c3f (25703acc-8103-4aad-8915-f89fea292c3f): created successfully Sep 10 20:01:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cf46523-f7eb-44d7-b289-8639e43f333c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] Flow 'volume_create_manager' (6c82de9c-09b4-4742-a3e5-5871577547d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:01:49 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-29c917d1-3373-4d99-961f-5bbe3fc9b91d tempest-ProjectReaderTests-814147704 None] Created volume successfully. Sep 10 20:01:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7abf07a5-538f-40d3-93b8-de5182192b8d tempest-ProjectReaderTests-814147704 None] Acquiring lock "cinder-25703acc-8103-4aad-8915-f89fea292c3f-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7abf07a5-538f-40d3-93b8-de5182192b8d tempest-ProjectReaderTests-814147704 None] Lock "cinder-25703acc-8103-4aad-8915-f89fea292c3f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7abf07a5-538f-40d3-93b8-de5182192b8d tempest-ProjectReaderTests-814147704 None] Acquiring lock "cinder-quobyte-25703acc-8103-4aad-8915-f89fea292c3f" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7abf07a5-538f-40d3-93b8-de5182192b8d tempest-ProjectReaderTests-814147704 None] Lock "cinder-quobyte-25703acc-8103-4aad-8915-f89fea292c3f" acquired by "delete_volume" :: waited 0.013s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:49 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b1a6a4-eef0-46e1-977e-4f5094623fc2]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:01:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7abf07a5-538f-40d3-93b8-de5182192b8d tempest-ProjectReaderTests-814147704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25703acc-8103-4aad-8915-f89fea292c3f {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:49 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25703acc-8103-4aad-8915-f89fea292c3f Sep 10 20:01:49 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:50 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7abf07a5-538f-40d3-93b8-de5182192b8d tempest-ProjectReaderTests-814147704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25703acc-8103-4aad-8915-f89fea292c3f" returned: 0 in 0.372s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7abf07a5-538f-40d3-93b8-de5182192b8d tempest-ProjectReaderTests-814147704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25703acc-8103-4aad-8915-f89fea292c3f {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:50 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25703acc-8103-4aad-8915-f89fea292c3f Sep 10 20:01:50 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:50 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7abf07a5-538f-40d3-93b8-de5182192b8d tempest-ProjectReaderTests-814147704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-25703acc-8103-4aad-8915-f89fea292c3f" returned: 0 in 0.246s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:50 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7abf07a5-538f-40d3-93b8-de5182192b8d tempest-ProjectReaderTests-814147704 None] Lock "cinder-quobyte-25703acc-8103-4aad-8915-f89fea292c3f" released by "delete_volume" :: held 0.657s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:50 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-7abf07a5-538f-40d3-93b8-de5182192b8d tempest-ProjectReaderTests-814147704 None] Created reservations ['4c25ec47-f97b-4cd1-a8a9-9671d5271002', '87dda5db-e5f6-4afc-8a14-b61d696c2aff', '735f8b2e-4836-4347-a949-d75f3c37a5fc', 'f427d531-b82a-40bd-9487-5043b2e1ac50'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:01:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7abf07a5-538f-40d3-93b8-de5182192b8d tempest-ProjectReaderTests-814147704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7abf07a5-538f-40d3-93b8-de5182192b8d tempest-ProjectReaderTests-814147704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:50 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7abf07a5-538f-40d3-93b8-de5182192b8d tempest-ProjectReaderTests-814147704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:01:50 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7abf07a5-538f-40d3-93b8-de5182192b8d tempest-ProjectReaderTests-814147704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:01:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7abf07a5-538f-40d3-93b8-de5182192b8d tempest-ProjectReaderTests-814147704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7abf07a5-538f-40d3-93b8-de5182192b8d tempest-ProjectReaderTests-814147704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:50 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:01:50 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:50 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7abf07a5-538f-40d3-93b8-de5182192b8d tempest-ProjectReaderTests-814147704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.286s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:50 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-7abf07a5-538f-40d3-93b8-de5182192b8d tempest-ProjectReaderTests-814147704 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:01:50 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-7abf07a5-538f-40d3-93b8-de5182192b8d tempest-ProjectReaderTests-814147704 None] Deleted volume successfully. Sep 10 20:01:50 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7abf07a5-538f-40d3-93b8-de5182192b8d tempest-ProjectReaderTests-814147704 None] Lock "cinder-25703acc-8103-4aad-8915-f89fea292c3f-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:51 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:01:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] Flow 'volume_create_manager' (7a7dbde8-122b-4f0b-9252-88ea5c7577f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:01:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7ca7cb4-389a-4f1f-866e-79d2bcf1e59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7ca7cb4-389a-4f1f-866e-79d2bcf1e59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1231049314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9048cd26-98dc-4079-9196-3999176d5968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b6f8fe22af4459d8670339c32ca3558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:01:51Z,use_quota=True,user_id='958b2bb7426549f6a54582f36f193888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d112e4de-6024-4bbe-8015-bb1a3dca40fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d112e4de-6024-4bbe-8015-bb1a3dca40fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11fcbc12-56a6-42b0-b78e-910f7e9f829f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11fcbc12-56a6-42b0-b78e-910f7e9f829f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9048cd26-98dc-4079-9196-3999176d5968', 'volume_name': 'volume-9048cd26-98dc-4079-9196-3999176d5968', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6826b5f3-ee24-44e3-a7fc-87721738310c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6826b5f3-ee24-44e3-a7fc-87721738310c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:51 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec7c6a85-739f-425b-b840-57ff96507683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:51 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] Volume 9048cd26-98dc-4079-9196-3999176d5968: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9048cd26-98dc-4079-9196-3999176d5968', 'volume_size': 1} Sep 10 20:01:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1231049314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9048cd26-98dc-4079-9196-3999176d5968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b6f8fe22af4459d8670339c32ca3558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:01:51Z,use_quota=True,user_id='958b2bb7426549f6a54582f36f193888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:01:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] Creating volume 9048cd26-98dc-4079-9196-3999176d5968 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:01:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:01:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:01:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:01:51 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:01:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9048cd26-98dc-4079-9196-3999176d5968 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:51 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9048cd26-98dc-4079-9196-3999176d5968 1073741824 Sep 10 20:01:51 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:51 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9048cd26-98dc-4079-9196-3999176d5968 1073741824" returned: 0 in 0.406s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9048cd26-98dc-4079-9196-3999176d5968 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:51 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9048cd26-98dc-4079-9196-3999176d5968 Sep 10 20:01:51 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:52 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9048cd26-98dc-4079-9196-3999176d5968" returned: 0 in 0.265s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:52 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:01:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:52 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec7c6a85-739f-425b-b840-57ff96507683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9048cd26-98dc-4079-9196-3999176d5968', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:52 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bbaaf73-332c-41ec-813c-3912c6b08b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:01:52 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] Volume volume-9048cd26-98dc-4079-9196-3999176d5968 (9048cd26-98dc-4079-9196-3999176d5968): created successfully Sep 10 20:01:52 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bbaaf73-332c-41ec-813c-3912c6b08b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:01:52 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] Flow 'volume_create_manager' (7a7dbde8-122b-4f0b-9252-88ea5c7577f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:01:52 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-d34cb1c9-70c0-4bae-9a48-e2f481c574ad tempest-ProjectReaderTests-814147704 None] Created volume successfully. Sep 10 20:01:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-380e9f9a-6cb1-4ad7-a365-62b3ef688aa4 tempest-ProjectReaderTests-814147704 None] Acquiring lock "cinder-9048cd26-98dc-4079-9196-3999176d5968-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-380e9f9a-6cb1-4ad7-a365-62b3ef688aa4 tempest-ProjectReaderTests-814147704 None] Lock "cinder-9048cd26-98dc-4079-9196-3999176d5968-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-380e9f9a-6cb1-4ad7-a365-62b3ef688aa4 tempest-ProjectReaderTests-814147704 None] Acquiring lock "cinder-quobyte-9048cd26-98dc-4079-9196-3999176d5968" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:01:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-380e9f9a-6cb1-4ad7-a365-62b3ef688aa4 tempest-ProjectReaderTests-814147704 None] Lock "cinder-quobyte-9048cd26-98dc-4079-9196-3999176d5968" acquired by "delete_volume" :: waited 0.017s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:01:52 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d38432d-dd35-4769-a7a9-6e0dc8426ec7]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:01:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-380e9f9a-6cb1-4ad7-a365-62b3ef688aa4 tempest-ProjectReaderTests-814147704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9048cd26-98dc-4079-9196-3999176d5968 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:52 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9048cd26-98dc-4079-9196-3999176d5968 Sep 10 20:01:52 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:52 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-380e9f9a-6cb1-4ad7-a365-62b3ef688aa4 tempest-ProjectReaderTests-814147704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9048cd26-98dc-4079-9196-3999176d5968" returned: 0 in 0.346s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-380e9f9a-6cb1-4ad7-a365-62b3ef688aa4 tempest-ProjectReaderTests-814147704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9048cd26-98dc-4079-9196-3999176d5968 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:52 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9048cd26-98dc-4079-9196-3999176d5968 Sep 10 20:01:52 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:52 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-380e9f9a-6cb1-4ad7-a365-62b3ef688aa4 tempest-ProjectReaderTests-814147704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9048cd26-98dc-4079-9196-3999176d5968" returned: 0 in 0.250s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-380e9f9a-6cb1-4ad7-a365-62b3ef688aa4 tempest-ProjectReaderTests-814147704 None] Lock "cinder-quobyte-9048cd26-98dc-4079-9196-3999176d5968" released by "delete_volume" :: held 0.634s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:01:53 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-380e9f9a-6cb1-4ad7-a365-62b3ef688aa4 tempest-ProjectReaderTests-814147704 None] Created reservations ['4e5e06f2-6184-46b9-bcb0-a4a03b70bf23', 'ac2861e4-678d-423b-95b9-890cecfe114c', '7da8e255-3a72-41b2-b5ad-7e14d051224b', '99abf727-98a3-4ca5-bad7-9c8da2b6c474'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:01:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-380e9f9a-6cb1-4ad7-a365-62b3ef688aa4 tempest-ProjectReaderTests-814147704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:01:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-380e9f9a-6cb1-4ad7-a365-62b3ef688aa4 tempest-ProjectReaderTests-814147704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:01:53 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-380e9f9a-6cb1-4ad7-a365-62b3ef688aa4 tempest-ProjectReaderTests-814147704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:01:53 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-380e9f9a-6cb1-4ad7-a365-62b3ef688aa4 tempest-ProjectReaderTests-814147704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:01:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-380e9f9a-6cb1-4ad7-a365-62b3ef688aa4 tempest-ProjectReaderTests-814147704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:01:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-380e9f9a-6cb1-4ad7-a365-62b3ef688aa4 tempest-ProjectReaderTests-814147704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:53 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:01:53 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:53 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-380e9f9a-6cb1-4ad7-a365-62b3ef688aa4 tempest-ProjectReaderTests-814147704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.263s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:53 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-380e9f9a-6cb1-4ad7-a365-62b3ef688aa4 tempest-ProjectReaderTests-814147704 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:01:53 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-380e9f9a-6cb1-4ad7-a365-62b3ef688aa4 tempest-ProjectReaderTests-814147704 None] Deleted volume successfully. Sep 10 20:01:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-380e9f9a-6cb1-4ad7-a365-62b3ef688aa4 tempest-ProjectReaderTests-814147704 None] Lock "cinder-9048cd26-98dc-4079-9196-3999176d5968-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:03 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:UPDATE=161,cinder:SELECT=109,cinder:DELETE=11,cinder:INSERT=36 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:02:03 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:UPDATE=29,cinder:SELECT=17,cinder:INSERT=4,cinder:DELETE=3 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:02:03 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:02:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:04 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:02:04 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:04 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.289s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:04 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:02:04 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager._thread_info {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:02:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread count: 28 {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:02:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread info: [<_MainThread(MainThread, started 138417491665024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] Flow 'volume_create_manager' (d9c1b9c9-f30c-4ecc-a706-bed50d372675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9853146-7467-4aeb-af45-a4a9874391a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9853146-7467-4aeb-af45-a4a9874391a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2119958742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=061561dc-be5c-4fcc-9b82-998f781bf7ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ccf10908bb4fee920fca4f7593181a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:06Z,use_quota=True,user_id='68ce8fdeaeee4fdb90f862c7dae7a26a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f8d0e3-74c6-4bfa-8c70-c3c6566ae9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f8d0e3-74c6-4bfa-8c70-c3c6566ae9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e10fcbd9-5cd6-406e-8bfe-b8c96f6ae501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e10fcbd9-5cd6-406e-8bfe-b8c96f6ae501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '061561dc-be5c-4fcc-9b82-998f781bf7ec', 'volume_name': 'volume-061561dc-be5c-4fcc-9b82-998f781bf7ec', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b85c4c-d306-4078-8992-9be54df6f732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b85c4c-d306-4078-8992-9be54df6f732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (050a6311-408e-4ff1-a408-3147f101d8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:06 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] Volume 061561dc-be5c-4fcc-9b82-998f781bf7ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-061561dc-be5c-4fcc-9b82-998f781bf7ec', 'volume_size': 1} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2119958742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=061561dc-be5c-4fcc-9b82-998f781bf7ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ccf10908bb4fee920fca4f7593181a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:06Z,use_quota=True,user_id='68ce8fdeaeee4fdb90f862c7dae7a26a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] Creating volume 061561dc-be5c-4fcc-9b82-998f781bf7ec {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:02:06 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-061561dc-be5c-4fcc-9b82-998f781bf7ec 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:06 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-061561dc-be5c-4fcc-9b82-998f781bf7ec 1073741824 Sep 10 20:02:06 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] Flow 'volume_create_manager' (dd629888-34f2-4112-b2f6-44eb990f3f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef96d45-c00a-49b4-ba3b-7793439763e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef96d45-c00a-49b4-ba3b-7793439763e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-187890988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a5bb6d-077a-4011-8c4e-7dee1676d246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f201ebd27d44fa4b772a2eab8384298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:07Z,use_quota=True,user_id='e1336796897848ea97a108c1da9a2b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fadbf1e5-03ce-486a-946c-eb4fe147a47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fadbf1e5-03ce-486a-946c-eb4fe147a47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a29005b8-c1b8-40ab-9baa-c60f3626056b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a29005b8-c1b8-40ab-9baa-c60f3626056b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42a5bb6d-077a-4011-8c4e-7dee1676d246', 'volume_name': 'volume-42a5bb6d-077a-4011-8c4e-7dee1676d246', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a3e9e66-2ab5-409a-898b-9c6eb4227149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a3e9e66-2ab5-409a-898b-9c6eb4227149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df7bf137-12cc-482b-bcae-895fd79c8acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:06 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] Volume 42a5bb6d-077a-4011-8c4e-7dee1676d246: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42a5bb6d-077a-4011-8c4e-7dee1676d246', 'volume_size': 1} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] Flow 'volume_create_manager' (5acf018b-974b-4702-af7e-fdc9a24f7cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4a1712-842f-4ec3-a599-5b376958de63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4a1712-842f-4ec3-a599-5b376958de63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1054140001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1c4b2c7-1fb6-466c-85c1-5b08039fa446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ccf10908bb4fee920fca4f7593181a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:07Z,use_quota=True,user_id='68ce8fdeaeee4fdb90f862c7dae7a26a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7731bac8-4866-40ed-b00c-34ae71f2fdf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7731bac8-4866-40ed-b00c-34ae71f2fdf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b3cb69-b6d6-48b1-9cb5-0f395086b5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b3cb69-b6d6-48b1-9cb5-0f395086b5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1c4b2c7-1fb6-466c-85c1-5b08039fa446', 'volume_name': 'volume-c1c4b2c7-1fb6-466c-85c1-5b08039fa446', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99871b3-9102-4fb0-bf56-567e30732479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99871b3-9102-4fb0-bf56-567e30732479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41a10000-2425-44e6-856a-cac852df69a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:06 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] Volume c1c4b2c7-1fb6-466c-85c1-5b08039fa446: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1c4b2c7-1fb6-466c-85c1-5b08039fa446', 'volume_size': 1} Sep 10 20:02:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] Flow 'volume_create_manager' (ef81990c-9a77-4062-b999-40de748dc5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f4c94a-7b6a-4f96-b9c6-0ae5913d3571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f4c94a-7b6a-4f96-b9c6-0ae5913d3571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7658d3dc-8c25-4808-a8f4-53c6bcc5acb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f01a2201b1442585d4a18a6e0bbfa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:07Z,use_quota=True,user_id='91de3bed14d44a41bfd5d3a00496a385',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39cdbba3-30c5-4893-b91b-bda4cebf3f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39cdbba3-30c5-4893-b91b-bda4cebf3f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b356f877-b277-4be4-af94-8fb15bdf7dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b356f877-b277-4be4-af94-8fb15bdf7dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7658d3dc-8c25-4808-a8f4-53c6bcc5acb8', 'volume_name': 'volume-7658d3dc-8c25-4808-a8f4-53c6bcc5acb8', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7838e9f5-e49a-44fd-bb55-eef8ec83787e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:07 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7838e9f5-e49a-44fd-bb55-eef8ec83787e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84254b55-6ee6-4e92-9de8-3d08ceba9d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:07 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] Volume 7658d3dc-8c25-4808-a8f4-53c6bcc5acb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7658d3dc-8c25-4808-a8f4-53c6bcc5acb8', 'volume_size': 1} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-061561dc-be5c-4fcc-9b82-998f781bf7ec 1073741824" returned: 0 in 0.733s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-061561dc-be5c-4fcc-9b82-998f781bf7ec {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:07 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-061561dc-be5c-4fcc-9b82-998f781bf7ec Sep 10 20:02:07 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] Flow 'volume_create_manager' (999353eb-6ce1-4517-aa53-929a33936a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a15d16-1efc-498c-8fdb-6a07fe5de19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a15d16-1efc-498c-8fdb-6a07fe5de19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1388754319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7aac6f8-f78b-469d-a031-43270e97a9f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ccf10908bb4fee920fca4f7593181a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:07Z,use_quota=True,user_id='68ce8fdeaeee4fdb90f862c7dae7a26a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f627fef-0adb-49bd-8c9d-b8edf2df9db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f627fef-0adb-49bd-8c9d-b8edf2df9db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497e3ab5-ffc2-4e79-8278-b6c3c30fe87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497e3ab5-ffc2-4e79-8278-b6c3c30fe87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7aac6f8-f78b-469d-a031-43270e97a9f1', 'volume_name': 'volume-f7aac6f8-f78b-469d-a031-43270e97a9f1', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e248925-d305-4e93-948c-e17408c4793c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e248925-d305-4e93-948c-e17408c4793c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (024a2e8d-760f-4b81-84c3-f29f466ed3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:07 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] Volume f7aac6f8-f78b-469d-a031-43270e97a9f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7aac6f8-f78b-469d-a031-43270e97a9f1', 'volume_size': 1} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:07 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-061561dc-be5c-4fcc-9b82-998f781bf7ec" returned: 0 in 0.362s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.783s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-187890988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a5bb6d-077a-4011-8c4e-7dee1676d246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f201ebd27d44fa4b772a2eab8384298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:07Z,use_quota=True,user_id='e1336796897848ea97a108c1da9a2b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] Creating volume 42a5bb6d-077a-4011-8c4e-7dee1676d246 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:02:07 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (050a6311-408e-4ff1-a408-3147f101d8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-061561dc-be5c-4fcc-9b82-998f781bf7ec', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (146d20a0-b444-4efb-bf56-4c1c99ad5532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:07 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246 1073741824 Sep 10 20:02:07 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:07 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] Volume volume-061561dc-be5c-4fcc-9b82-998f781bf7ec (061561dc-be5c-4fcc-9b82-998f781bf7ec): created successfully Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (146d20a0-b444-4efb-bf56-4c1c99ad5532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] Flow 'volume_create_manager' (d9c1b9c9-f30c-4ecc-a706-bed50d372675) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:07 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-f76ec58b-3f80-4301-894a-5c1c28d455e6 tempest-CreateVolumesFromImageTest-928311851 None] Created volume successfully. Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] Flow 'volume_create_manager' (5e63c728-5edd-4727-97cc-a3b7ad271d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd77373-eb7d-47ef-99bc-39e5c532bec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd77373-eb7d-47ef-99bc-39e5c532bec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-943668801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a60fcb7-5d98-4f2a-bf0c-fee7b9127249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ccf10908bb4fee920fca4f7593181a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:08Z,use_quota=True,user_id='68ce8fdeaeee4fdb90f862c7dae7a26a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb61f942-edd2-430d-b289-9b133b7211e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb61f942-edd2-430d-b289-9b133b7211e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d1d480-150e-4c29-9575-dab7c9af59d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d1d480-150e-4c29-9575-dab7c9af59d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a60fcb7-5d98-4f2a-bf0c-fee7b9127249', 'volume_name': 'volume-9a60fcb7-5d98-4f2a-bf0c-fee7b9127249', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a00e234-fea7-449b-97d6-5f1de069530a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a00e234-fea7-449b-97d6-5f1de069530a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d8fe20-62d9-42b5-8013-e1c41bb080d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:07 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] Volume 9a60fcb7-5d98-4f2a-bf0c-fee7b9127249: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a60fcb7-5d98-4f2a-bf0c-fee7b9127249', 'volume_size': 1} Sep 10 20:02:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:08 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246 1073741824" returned: 0 in 0.665s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:08 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:02:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] Flow 'volume_create_manager' (6dfca96a-94de-4508-af24-8b819a9562c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4793b5e3-e9a0-4c54-be80-85a665208b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4793b5e3-e9a0-4c54-be80-85a665208b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-703072034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb5b28ad-42c1-450c-90dc-36dd68a8e7cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ccf10908bb4fee920fca4f7593181a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:08Z,use_quota=True,user_id='68ce8fdeaeee4fdb90f862c7dae7a26a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9bf339-a4f9-4d27-b3bb-abbc1c4961d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9bf339-a4f9-4d27-b3bb-abbc1c4961d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ae9ddcc-7deb-4c36-addc-47420ba2afbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ae9ddcc-7deb-4c36-addc-47420ba2afbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb5b28ad-42c1-450c-90dc-36dd68a8e7cb', 'volume_name': 'volume-bb5b28ad-42c1-450c-90dc-36dd68a8e7cb', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23dbc3a3-b836-4649-9004-1a02c2460639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23dbc3a3-b836-4649-9004-1a02c2460639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fe49892-a1d4-468e-a7ec-0c31013b5469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:08 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] Volume bb5b28ad-42c1-450c-90dc-36dd68a8e7cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb5b28ad-42c1-450c-90dc-36dd68a8e7cb', 'volume_size': 1} Sep 10 20:02:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:08 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246 Sep 10 20:02:08 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:08 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246" returned: 0 in 0.272s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:02:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.700s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1054140001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1c4b2c7-1fb6-466c-85c1-5b08039fa446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ccf10908bb4fee920fca4f7593181a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:07Z,use_quota=True,user_id='68ce8fdeaeee4fdb90f862c7dae7a26a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:02:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] Creating volume c1c4b2c7-1fb6-466c-85c1-5b08039fa446 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:02:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:02:08 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:02:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c1c4b2c7-1fb6-466c-85c1-5b08039fa446 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:08 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c1c4b2c7-1fb6-466c-85c1-5b08039fa446 1073741824 Sep 10 20:02:08 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df7bf137-12cc-482b-bcae-895fd79c8acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42a5bb6d-077a-4011-8c4e-7dee1676d246', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c38dde-2917-43d9-b865-9817947be85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:08 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] Volume volume-42a5bb6d-077a-4011-8c4e-7dee1676d246 (42a5bb6d-077a-4011-8c4e-7dee1676d246): created successfully Sep 10 20:02:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c38dde-2917-43d9-b865-9817947be85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] Flow 'volume_create_manager' (dd629888-34f2-4112-b2f6-44eb990f3f90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:08 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-635611ce-f619-429d-82bc-a8a00f12b4cc tempest-VolumeDependencyTests-199317518 None] Created volume successfully. Sep 10 20:02:09 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c1c4b2c7-1fb6-466c-85c1-5b08039fa446 1073741824" returned: 0 in 0.459s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c1c4b2c7-1fb6-466c-85c1-5b08039fa446 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:09 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c1c4b2c7-1fb6-466c-85c1-5b08039fa446 Sep 10 20:02:09 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:09 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c1c4b2c7-1fb6-466c-85c1-5b08039fa446" returned: 0 in 0.252s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:09 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:02:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.286s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:09 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7658d3dc-8c25-4808-a8f4-53c6bcc5acb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f01a2201b1442585d4a18a6e0bbfa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:07Z,use_quota=True,user_id='91de3bed14d44a41bfd5d3a00496a385',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:02:09 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] Creating volume 7658d3dc-8c25-4808-a8f4-53c6bcc5acb8 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:02:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:09 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:09 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:09 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:02:09 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:02:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7658d3dc-8c25-4808-a8f4-53c6bcc5acb8 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:09 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41a10000-2425-44e6-856a-cac852df69a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1c4b2c7-1fb6-466c-85c1-5b08039fa446', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:09 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7658d3dc-8c25-4808-a8f4-53c6bcc5acb8 1073741824 Sep 10 20:02:09 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:09 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb0ec718-eb11-4d7f-8a92-11ea82b01333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:09 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] Volume volume-c1c4b2c7-1fb6-466c-85c1-5b08039fa446 (c1c4b2c7-1fb6-466c-85c1-5b08039fa446): created successfully Sep 10 20:02:09 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb0ec718-eb11-4d7f-8a92-11ea82b01333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:09 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] Flow 'volume_create_manager' (5acf018b-974b-4702-af7e-fdc9a24f7cdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:09 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-39291180-ba22-4c7f-b3e0-a602dbf8ae1e tempest-CreateVolumesFromImageTest-928311851 None] Created volume successfully. Sep 10 20:02:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-dcb8d5e4-838c-4d68-8b42-72e5f9b284e7 tempest-VolumeDependencyTests-199317518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:09 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7658d3dc-8c25-4808-a8f4-53c6bcc5acb8 1073741824" returned: 0 in 0.557s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7658d3dc-8c25-4808-a8f4-53c6bcc5acb8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:10 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7658d3dc-8c25-4808-a8f4-53c6bcc5acb8 Sep 10 20:02:10 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:10 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7658d3dc-8c25-4808-a8f4-53c6bcc5acb8" returned: 0 in 0.250s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.765s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1388754319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7aac6f8-f78b-469d-a031-43270e97a9f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ccf10908bb4fee920fca4f7593181a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:07Z,use_quota=True,user_id='68ce8fdeaeee4fdb90f862c7dae7a26a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] Creating volume f7aac6f8-f78b-469d-a031-43270e97a9f1 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:02:10 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f7aac6f8-f78b-469d-a031-43270e97a9f1 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84254b55-6ee6-4e92-9de8-3d08ceba9d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7658d3dc-8c25-4808-a8f4-53c6bcc5acb8', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bba47c0d-e465-4cc6-8b49-393367005c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:10 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f7aac6f8-f78b-469d-a031-43270e97a9f1 1073741824 Sep 10 20:02:10 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:10 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] Volume volume-7658d3dc-8c25-4808-a8f4-53c6bcc5acb8 (7658d3dc-8c25-4808-a8f4-53c6bcc5acb8): created successfully Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bba47c0d-e465-4cc6-8b49-393367005c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] Flow 'volume_create_manager' (ef81990c-9a77-4062-b999-40de748dc5f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:10 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-6b003482-5e5e-47bc-b8be-3659aba992bc tempest-CinderUnicodeTest-727280680 None] Created volume successfully. Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Flow 'volume_create_manager' (920c006d-275b-45c1-9988-0fef71a6a0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6efa8c0-e120-4c36-9f91-794e0dcb54fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6efa8c0-e120-4c36-9f91-794e0dcb54fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=194d89c4-72dc-434c-9c8b-87fb7290a7b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f72b73f3f946f6b83f805fada2dcac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:11Z,use_quota=True,user_id='5d9bd317159c43aa8f293ae24f0d5785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c266bee-4261-41ec-82fc-6d474b3ad1a3),volume_type_id=7c266bee-4261-41ec-82fc-6d474b3ad1a3)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a415faa-40b9-4ab9-9591-039367653bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a415faa-40b9-4ab9-9591-039367653bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7721a122-5a18-4b1f-86d4-3db695f27253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG cinder.image.glance [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Creating Keystone auth plugin from conf {{(pid=88093) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 20:02:10 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f7aac6f8-f78b-469d-a031-43270e97a9f1 1073741824" returned: 0 in 0.530s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f7aac6f8-f78b-469d-a031-43270e97a9f1 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:10 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f7aac6f8-f78b-469d-a031-43270e97a9f1 Sep 10 20:02:10 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7721a122-5a18-4b1f-86d4-3db695f27253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '194d89c4-72dc-434c-9c8b-87fb7290a7b4', 'volume_name': 'volume-194d89c4-72dc-434c-9c8b-87fb7290a7b4', 'volume_size': 1, 'image_id': '55abd4b7-8ce2-4fdc-962f-fead13234174', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55abd4b7-8ce2-4fdc-962f-fead13234174', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4a7fcfffe555041e63a08cd9a23388fe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '45f72b73f3f946f6b83f805fada2dcac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6694e9d9a01fef67095a7d594ead3b9c471d991637546b29cef0249ba25627af634d43e2fac4d70a50590d6fd02bf42e0aed4b102bc8165393af9f435ccc792b', 'id': '55abd4b7-8ce2-4fdc-962f-fead13234174', 'created_at': datetime.datetime(2026, 9, 10, 18, 2, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 18, 2, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55abd4b7-8ce2-4fdc-962f-fead13234174/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea29a4b-ea73-4ef4-9383-a02a3be74eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea29a4b-ea73-4ef4-9383-a02a3be74eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fd724fc-e0ff-4036-8b78-831febe6e2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:10 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Volume 194d89c4-72dc-434c-9c8b-87fb7290a7b4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-194d89c4-72dc-434c-9c8b-87fb7290a7b4', 'volume_size': 1, 'image_id': '55abd4b7-8ce2-4fdc-962f-fead13234174', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55abd4b7-8ce2-4fdc-962f-fead13234174', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4a7fcfffe555041e63a08cd9a23388fe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '45f72b73f3f946f6b83f805fada2dcac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6694e9d9a01fef67095a7d594ead3b9c471d991637546b29cef0249ba25627af634d43e2fac4d70a50590d6fd02bf42e0aed4b102bc8165393af9f435ccc792b', 'id': '55abd4b7-8ce2-4fdc-962f-fead13234174', 'created_at': datetime.datetime(2026, 9, 10, 18, 2, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 18, 2, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55abd4b7-8ce2-4fdc-962f-fead13234174/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 10 20:02:10 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Trying to clone 194d89c4-72dc-434c-9c8b-87fb7290a7b4 from image 55abd4b7-8ce2-4fdc-962f-fead13234174 at location (None, [{'url': 'file:///opt/stack/data/glance/images/55abd4b7-8ce2-4fdc-962f-fead13234174', 'metadata': {}}]). {{(pid=88093) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_55abd4b7-8ce2-4fdc-962f-fead13234174_cj9mqdi3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88093) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 20:02:11 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Image download 0.00 MB at 0.00 MB/s Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8e3778-2c48-47dc-90b6-192a19196108]: (4, 'raw') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55abd4b7-8ce2-4fdc-962f-fead13234174_cj9mqdi3devstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:11 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f7aac6f8-f78b-469d-a031-43270e97a9f1" returned: 0 in 0.253s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.154s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-943668801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a60fcb7-5d98-4f2a-bf0c-fee7b9127249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ccf10908bb4fee920fca4f7593181a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:08Z,use_quota=True,user_id='68ce8fdeaeee4fdb90f862c7dae7a26a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] Creating volume 9a60fcb7-5d98-4f2a-bf0c-fee7b9127249 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:02:11 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9a60fcb7-5d98-4f2a-bf0c-fee7b9127249 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (024a2e8d-760f-4b81-84c3-f29f466ed3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7aac6f8-f78b-469d-a031-43270e97a9f1', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f9923b-102c-46f5-9823-84217d5c2fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:11 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9a60fcb7-5d98-4f2a-bf0c-fee7b9127249 1073741824 Sep 10 20:02:11 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:11 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] Volume volume-f7aac6f8-f78b-469d-a031-43270e97a9f1 (f7aac6f8-f78b-469d-a031-43270e97a9f1): created successfully Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f9923b-102c-46f5-9823-84217d5c2fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] Flow 'volume_create_manager' (999353eb-6ce1-4517-aa53-929a33936a63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:11 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-d7f0e1ec-efc6-456b-9b52-556ec9c26b02 tempest-CreateVolumesFromImageTest-928311851 None] Created volume successfully. Sep 10 20:02:11 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55abd4b7-8ce2-4fdc-962f-fead13234174_cj9mqdi3devstack@QuobyteHD Sep 10 20:02:11 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:11 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55abd4b7-8ce2-4fdc-962f-fead13234174_cj9mqdi3devstack@QuobyteHD" returned: 0 in 0.349s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55abd4b7-8ce2-4fdc-962f-fead13234174_cj9mqdi3devstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:11 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55abd4b7-8ce2-4fdc-962f-fead13234174_cj9mqdi3devstack@QuobyteHD Sep 10 20:02:11 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:11 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9a60fcb7-5d98-4f2a-bf0c-fee7b9127249 1073741824" returned: 0 in 0.512s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9a60fcb7-5d98-4f2a-bf0c-fee7b9127249 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:11 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9a60fcb7-5d98-4f2a-bf0c-fee7b9127249 Sep 10 20:02:11 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:11 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55abd4b7-8ce2-4fdc-962f-fead13234174_cj9mqdi3devstack@QuobyteHD" returned: 1 in 0.417s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55abd4b7-8ce2-4fdc-962f-fead13234174_cj9mqdi3devstack@QuobyteHD' failed. Not Retrying. {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Temporary image 55abd4b7-8ce2-4fdc-962f-fead13234174 is fetched for user 5d9bd317159c43aa8f293ae24f0d5785. {{(pid=88093) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] Flow 'volume_create_manager' (801955ad-926a-44d9-aead-aa0133b528f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:11 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05890e14-5610-41c9-b714-a08195638814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9a60fcb7-5d98-4f2a-bf0c-fee7b9127249" returned: 0 in 0.260s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.572s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-703072034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb5b28ad-42c1-450c-90dc-36dd68a8e7cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ccf10908bb4fee920fca4f7593181a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:08Z,use_quota=True,user_id='68ce8fdeaeee4fdb90f862c7dae7a26a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] Creating volume bb5b28ad-42c1-450c-90dc-36dd68a8e7cb {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:02:11 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bb5b28ad-42c1-450c-90dc-36dd68a8e7cb 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:11 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bb5b28ad-42c1-450c-90dc-36dd68a8e7cb 1073741824 Sep 10 20:02:11 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05890e14-5610-41c9-b714-a08195638814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1774775784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ef53227-86f0-4ecc-8626-1ca253764db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f01a2201b1442585d4a18a6e0bbfa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:12Z,use_quota=True,user_id='91de3bed14d44a41bfd5d3a00496a385',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2598c3fc-9ab7-41b3-937d-be518676ff47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2598c3fc-9ab7-41b3-937d-be518676ff47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9176d7-65a6-4ce9-bc7c-87a89c4d29b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9176d7-65a6-4ce9-bc7c-87a89c4d29b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ef53227-86f0-4ecc-8626-1ca253764db4', 'volume_name': 'volume-7ef53227-86f0-4ecc-8626-1ca253764db4', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b51c02f1-3a58-42d7-8171-8dfbed3df08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b51c02f1-3a58-42d7-8171-8dfbed3df08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d06c2a0-4790-4b03-b9b0-eb53fdc2f1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:12 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] Volume 7ef53227-86f0-4ecc-8626-1ca253764db4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ef53227-86f0-4ecc-8626-1ca253764db4', 'volume_size': 1} Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d8fe20-62d9-42b5-8013-e1c41bb080d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a60fcb7-5d98-4f2a-bf0c-fee7b9127249', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea1bca9-e853-42b2-a929-b26b79269902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:12 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] Volume volume-9a60fcb7-5d98-4f2a-bf0c-fee7b9127249 (9a60fcb7-5d98-4f2a-bf0c-fee7b9127249): created successfully Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea1bca9-e853-42b2-a929-b26b79269902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] Flow 'volume_create_manager' (5e63c728-5edd-4727-97cc-a3b7ad271d28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[816039e9-3e08-40a2-a9f3-3040536a1c5d]: (4, 'raw') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55abd4b7-8ce2-4fdc-962f-fead13234174_cj9mqdi3devstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:12 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-88e7d81f-b300-48fa-84e6-79b5e4fd86a6 tempest-CreateVolumesFromImageTest-928311851 None] Created volume successfully. Sep 10 20:02:12 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55abd4b7-8ce2-4fdc-962f-fead13234174_cj9mqdi3devstack@QuobyteHD Sep 10 20:02:12 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:12 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bb5b28ad-42c1-450c-90dc-36dd68a8e7cb 1073741824" returned: 0 in 0.430s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:12 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55abd4b7-8ce2-4fdc-962f-fead13234174_cj9mqdi3devstack@QuobyteHD" returned: 0 in 0.349s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55abd4b7-8ce2-4fdc-962f-fead13234174_cj9mqdi3devstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bb5b28ad-42c1-450c-90dc-36dd68a8e7cb {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:12 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bb5b28ad-42c1-450c-90dc-36dd68a8e7cb Sep 10 20:02:12 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:12 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55abd4b7-8ce2-4fdc-962f-fead13234174_cj9mqdi3devstack@QuobyteHD Sep 10 20:02:12 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:12 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bb5b28ad-42c1-450c-90dc-36dd68a8e7cb" returned: 0 in 0.258s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-dcb8d5e4-838c-4d68-8b42-72e5f9b284e7 tempest-VolumeDependencyTests-199317518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.819s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fe49892-a1d4-468e-a7ec-0c31013b5469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb5b28ad-42c1-450c-90dc-36dd68a8e7cb', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db042e8c-473f-46a5-b63c-3f1293c1af70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-dcb8d5e4-838c-4d68-8b42-72e5f9b284e7 tempest-VolumeDependencyTests-199317518 None] Creating offline snapshot 1ac05a4a-faac-43af-bb87-f90df1174a8d of volume 42a5bb6d-077a-4011-8c4e-7dee1676d246 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[2472b8c1-5864-453c-86b9-a6f9c96bde1a]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:12 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] Volume volume-bb5b28ad-42c1-450c-90dc-36dd68a8e7cb (bb5b28ad-42c1-450c-90dc-36dd68a8e7cb): created successfully Sep 10 20:02:12 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db042e8c-473f-46a5-b63c-3f1293c1af70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] Flow 'volume_create_manager' (6dfca96a-94de-4508-af24-8b819a9562c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-dcb8d5e4-838c-4d68-8b42-72e5f9b284e7 tempest-VolumeDependencyTests-199317518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55abd4b7-8ce2-4fdc-962f-fead13234174_cj9mqdi3devstack@QuobyteHD" returned: 1 in 0.371s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55abd4b7-8ce2-4fdc-962f-fead13234174_cj9mqdi3devstack@QuobyteHD' failed. Not Retrying. {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:02:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:12 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-c6cd559b-8e77-45d4-bfd0-63b57970a390 tempest-CreateVolumesFromImageTest-928311851 None] Created volume successfully. Sep 10 20:02:12 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246 Sep 10 20:02:12 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:13 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-dcb8d5e4-838c-4d68-8b42-72e5f9b284e7 tempest-VolumeDependencyTests-199317518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246" returned: 0 in 0.345s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-dcb8d5e4-838c-4d68-8b42-72e5f9b284e7 tempest-VolumeDependencyTests-199317518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246.1ac05a4a-faac-43af-bb87-f90df1174a8d 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:13 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246.1ac05a4a-faac-43af-bb87-f90df1174a8d 1G Sep 10 20:02:13 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:13 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-dcb8d5e4-838c-4d68-8b42-72e5f9b284e7 tempest-VolumeDependencyTests-199317518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246.1ac05a4a-faac-43af-bb87-f90df1174a8d 1G" returned: 0 in 0.373s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-dcb8d5e4-838c-4d68-8b42-72e5f9b284e7 tempest-VolumeDependencyTests-199317518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42a5bb6d-077a-4011-8c4e-7dee1676d246 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246.1ac05a4a-faac-43af-bb87-f90df1174a8d {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:13 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42a5bb6d-077a-4011-8c4e-7dee1676d246 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246.1ac05a4a-faac-43af-bb87-f90df1174a8d Sep 10 20:02:13 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:13 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-dcb8d5e4-838c-4d68-8b42-72e5f9b284e7 tempest-VolumeDependencyTests-199317518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42a5bb6d-077a-4011-8c4e-7dee1676d246 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246.1ac05a4a-faac-43af-bb87-f90df1174a8d" returned: 0 in 0.312s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:13 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-dcb8d5e4-838c-4d68-8b42-72e5f9b284e7 tempest-VolumeDependencyTests-199317518 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246.1ac05a4a-faac-43af-bb87-f90df1174a8d is being set with open permissions: ugo+rw Sep 10 20:02:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-dcb8d5e4-838c-4d68-8b42-72e5f9b284e7 tempest-VolumeDependencyTests-199317518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246.1ac05a4a-faac-43af-bb87-f90df1174a8d {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:13 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246.1ac05a4a-faac-43af-bb87-f90df1174a8d Sep 10 20:02:13 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:13 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-8af2dd21-e339-4b19-8504-dd8e16d7e5b5 tempest-CreateVolumesFromImageTest-928311851 None] Acquiring lock "cinder-bb5b28ad-42c1-450c-90dc-36dd68a8e7cb-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:13 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-8af2dd21-e339-4b19-8504-dd8e16d7e5b5 tempest-CreateVolumesFromImageTest-928311851 None] Lock "cinder-bb5b28ad-42c1-450c-90dc-36dd68a8e7cb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:13 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-8af2dd21-e339-4b19-8504-dd8e16d7e5b5 tempest-CreateVolumesFromImageTest-928311851 None] Acquiring lock "cinder-quobyte-bb5b28ad-42c1-450c-90dc-36dd68a8e7cb" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:13 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-8af2dd21-e339-4b19-8504-dd8e16d7e5b5 tempest-CreateVolumesFromImageTest-928311851 None] Lock "cinder-quobyte-bb5b28ad-42c1-450c-90dc-36dd68a8e7cb" acquired by "delete_volume" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:14 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[84eec1d2-88e5-498d-b746-0cef374a03ef]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8af2dd21-e339-4b19-8504-dd8e16d7e5b5 tempest-CreateVolumesFromImageTest-928311851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bb5b28ad-42c1-450c-90dc-36dd68a8e7cb {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:14 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-dcb8d5e4-838c-4d68-8b42-72e5f9b284e7 tempest-VolumeDependencyTests-199317518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246.1ac05a4a-faac-43af-bb87-f90df1174a8d" returned: 0 in 0.270s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:14 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bb5b28ad-42c1-450c-90dc-36dd68a8e7cb Sep 10 20:02:14 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-dcb8d5e4-838c-4d68-8b42-72e5f9b284e7 tempest-VolumeDependencyTests-199317518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:14 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246.info Sep 10 20:02:14 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:14 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8af2dd21-e339-4b19-8504-dd8e16d7e5b5 tempest-CreateVolumesFromImageTest-928311851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bb5b28ad-42c1-450c-90dc-36dd68a8e7cb" returned: 0 in 0.372s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8af2dd21-e339-4b19-8504-dd8e16d7e5b5 tempest-CreateVolumesFromImageTest-928311851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bb5b28ad-42c1-450c-90dc-36dd68a8e7cb {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:14 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-dcb8d5e4-838c-4d68-8b42-72e5f9b284e7 tempest-VolumeDependencyTests-199317518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246.info" returned: 0 in 0.276s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:14 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-dcb8d5e4-838c-4d68-8b42-72e5f9b284e7 tempest-VolumeDependencyTests-199317518 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246.info is being set with open permissions: ugo+rw Sep 10 20:02:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-dcb8d5e4-838c-4d68-8b42-72e5f9b284e7 tempest-VolumeDependencyTests-199317518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:14 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bb5b28ad-42c1-450c-90dc-36dd68a8e7cb Sep 10 20:02:14 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:14 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246.info Sep 10 20:02:14 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:14 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8af2dd21-e339-4b19-8504-dd8e16d7e5b5 tempest-CreateVolumesFromImageTest-928311851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bb5b28ad-42c1-450c-90dc-36dd68a8e7cb" returned: 0 in 0.251s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-8af2dd21-e339-4b19-8504-dd8e16d7e5b5 tempest-CreateVolumesFromImageTest-928311851 None] Lock "cinder-quobyte-bb5b28ad-42c1-450c-90dc-36dd68a8e7cb" released by "delete_volume" :: held 0.673s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:14 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-dcb8d5e4-838c-4d68-8b42-72e5f9b284e7 tempest-VolumeDependencyTests-199317518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246.info" returned: 0 in 0.258s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-dcb8d5e4-838c-4d68-8b42-72e5f9b284e7 tempest-VolumeDependencyTests-199317518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.961s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.643s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1774775784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ef53227-86f0-4ecc-8626-1ca253764db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f01a2201b1442585d4a18a6e0bbfa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:12Z,use_quota=True,user_id='91de3bed14d44a41bfd5d3a00496a385',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:02:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] Creating volume 7ef53227-86f0-4ecc-8626-1ca253764db4 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:02:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:02:14 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:02:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:14 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4 1073741824 Sep 10 20:02:14 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:14 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-dcb8d5e4-838c-4d68-8b42-72e5f9b284e7 tempest-VolumeDependencyTests-199317518 None] Create snapshot completed successfully Sep 10 20:02:14 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-8af2dd21-e339-4b19-8504-dd8e16d7e5b5 tempest-CreateVolumesFromImageTest-928311851 None] Created reservations ['b4285202-dd56-4a04-8ef9-8240343f7246', '2b1cc4c2-70d3-438b-ba28-e56577fc78e4', 'd72a3962-7563-4a61-aa4d-e2018407f51c', '520722ab-5983-4423-9346-3ac4a103de8f'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:02:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-8af2dd21-e339-4b19-8504-dd8e16d7e5b5 tempest-CreateVolumesFromImageTest-928311851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-8af2dd21-e339-4b19-8504-dd8e16d7e5b5 tempest-CreateVolumesFromImageTest-928311851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-8af2dd21-e339-4b19-8504-dd8e16d7e5b5 tempest-CreateVolumesFromImageTest-928311851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-8af2dd21-e339-4b19-8504-dd8e16d7e5b5 tempest-CreateVolumesFromImageTest-928311851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-8af2dd21-e339-4b19-8504-dd8e16d7e5b5 tempest-CreateVolumesFromImageTest-928311851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8af2dd21-e339-4b19-8504-dd8e16d7e5b5 tempest-CreateVolumesFromImageTest-928311851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:14 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:02:14 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-17b714dd-1e1d-414c-9685-8b9a6268dd13 tempest-CreateVolumesFromImageTest-928311851 None] Acquiring lock "cinder-9a60fcb7-5d98-4f2a-bf0c-fee7b9127249-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-17b714dd-1e1d-414c-9685-8b9a6268dd13 tempest-CreateVolumesFromImageTest-928311851 None] Lock "cinder-9a60fcb7-5d98-4f2a-bf0c-fee7b9127249-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-17b714dd-1e1d-414c-9685-8b9a6268dd13 tempest-CreateVolumesFromImageTest-928311851 None] Acquiring lock "cinder-quobyte-9a60fcb7-5d98-4f2a-bf0c-fee7b9127249" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:15 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8af2dd21-e339-4b19-8504-dd8e16d7e5b5 tempest-CreateVolumesFromImageTest-928311851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.332s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-8af2dd21-e339-4b19-8504-dd8e16d7e5b5 tempest-CreateVolumesFromImageTest-928311851 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-17b714dd-1e1d-414c-9685-8b9a6268dd13 tempest-CreateVolumesFromImageTest-928311851 None] Lock "cinder-quobyte-9a60fcb7-5d98-4f2a-bf0c-fee7b9127249" acquired by "delete_volume" :: waited 0.021s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:15 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-8af2dd21-e339-4b19-8504-dd8e16d7e5b5 tempest-CreateVolumesFromImageTest-928311851 None] Deleted volume successfully. Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[242a5180-902c-444e-aaa3-b536924ab5b2]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-17b714dd-1e1d-414c-9685-8b9a6268dd13 tempest-CreateVolumesFromImageTest-928311851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9a60fcb7-5d98-4f2a-bf0c-fee7b9127249 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-8af2dd21-e339-4b19-8504-dd8e16d7e5b5 tempest-CreateVolumesFromImageTest-928311851 None] Lock "cinder-bb5b28ad-42c1-450c-90dc-36dd68a8e7cb-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:15 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4 1073741824" returned: 0 in 0.607s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:15 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9a60fcb7-5d98-4f2a-bf0c-fee7b9127249 Sep 10 20:02:15 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:15 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4 Sep 10 20:02:15 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:15 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4" returned: 0 in 0.316s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.855s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=194d89c4-72dc-434c-9c8b-87fb7290a7b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f72b73f3f946f6b83f805fada2dcac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:11Z,use_quota=True,user_id='5d9bd317159c43aa8f293ae24f0d5785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c266bee-4261-41ec-82fc-6d474b3ad1a3),volume_type_id=7c266bee-4261-41ec-82fc-6d474b3ad1a3)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Creating volume 194d89c4-72dc-434c-9c8b-87fb7290a7b4 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:02:15 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-194d89c4-72dc-434c-9c8b-87fb7290a7b4 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:15 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-17b714dd-1e1d-414c-9685-8b9a6268dd13 tempest-CreateVolumesFromImageTest-928311851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9a60fcb7-5d98-4f2a-bf0c-fee7b9127249" returned: 0 in 0.438s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-17b714dd-1e1d-414c-9685-8b9a6268dd13 tempest-CreateVolumesFromImageTest-928311851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9a60fcb7-5d98-4f2a-bf0c-fee7b9127249 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:15 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-194d89c4-72dc-434c-9c8b-87fb7290a7b4 1073741824 Sep 10 20:02:15 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d06c2a0-4790-4b03-b9b0-eb53fdc2f1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ef53227-86f0-4ecc-8626-1ca253764db4', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d5add1-2367-448a-8152-4c07a6ec9622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:15 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9a60fcb7-5d98-4f2a-bf0c-fee7b9127249 Sep 10 20:02:15 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:15 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] Volume volume-7ef53227-86f0-4ecc-8626-1ca253764db4 (7ef53227-86f0-4ecc-8626-1ca253764db4): created successfully Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d5add1-2367-448a-8152-4c07a6ec9622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] Flow 'volume_create_manager' (801955ad-926a-44d9-aead-aa0133b528f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:15 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-9d29f118-2955-47ac-b877-f4e96a9fa63d tempest-CinderUnicodeTest-727280680 None] Created volume successfully. Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Flow 'volume_create_manager' (61e31ce8-f222-40c4-b4eb-b36cb11f2916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2f0d87-a3f4-4691-b0d0-d149b2f2f47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2f0d87-a3f4-4691-b0d0-d149b2f2f47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-617766453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7327e40d-666f-4487-b96b-022355e9042a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f201ebd27d44fa4b772a2eab8384298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1ac05a4a-faac-43af-bb87-f90df1174a8d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:16Z,use_quota=True,user_id='e1336796897848ea97a108c1da9a2b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2bb76c8-e526-4852-8671-9e192bf31d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2bb76c8-e526-4852-8671-9e192bf31d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f174aa54-807f-4449-8f89-f347e94c707c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f174aa54-807f-4449-8f89-f347e94c707c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7327e40d-666f-4487-b96b-022355e9042a', 'volume_name': 'volume-7327e40d-666f-4487-b96b-022355e9042a', 'volume_size': 1, 'snapshot_id': '1ac05a4a-faac-43af-bb87-f90df1174a8d'}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbdb7981-f55f-4300-8eed-fb15c0b624c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbdb7981-f55f-4300-8eed-fb15c0b624c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65cc523c-3469-4189-9dda-2e2e7d8aa928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:15 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Volume 7327e40d-666f-4487-b96b-022355e9042a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7327e40d-666f-4487-b96b-022355e9042a', 'volume_size': 1, 'snapshot_id': '1ac05a4a-faac-43af-bb87-f90df1174a8d'} Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:15 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-17b714dd-1e1d-414c-9685-8b9a6268dd13 tempest-CreateVolumesFromImageTest-928311851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9a60fcb7-5d98-4f2a-bf0c-fee7b9127249" returned: 0 in 0.309s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-17b714dd-1e1d-414c-9685-8b9a6268dd13 tempest-CreateVolumesFromImageTest-928311851 None] Lock "cinder-quobyte-9a60fcb7-5d98-4f2a-bf0c-fee7b9127249" released by "delete_volume" :: held 0.808s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-17b714dd-1e1d-414c-9685-8b9a6268dd13 tempest-CreateVolumesFromImageTest-928311851 None] Created reservations ['da7e3f05-f4fc-42b5-b279-8ffceebe91a7', 'ed8c6580-c267-4d1f-87b8-6136fa875a60', 'cf0fe273-f5a6-4a38-baa9-4594accce98e', 'ce2d228f-c85e-4f29-97af-6dc6173b2ec6'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-17b714dd-1e1d-414c-9685-8b9a6268dd13 tempest-CreateVolumesFromImageTest-928311851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-17b714dd-1e1d-414c-9685-8b9a6268dd13 tempest-CreateVolumesFromImageTest-928311851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-17b714dd-1e1d-414c-9685-8b9a6268dd13 tempest-CreateVolumesFromImageTest-928311851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-17b714dd-1e1d-414c-9685-8b9a6268dd13 tempest-CreateVolumesFromImageTest-928311851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-17b714dd-1e1d-414c-9685-8b9a6268dd13 tempest-CreateVolumesFromImageTest-928311851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-17b714dd-1e1d-414c-9685-8b9a6268dd13 tempest-CreateVolumesFromImageTest-928311851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:16 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:02:16 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:16 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-194d89c4-72dc-434c-9c8b-87fb7290a7b4 1073741824" returned: 0 in 0.528s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-194d89c4-72dc-434c-9c8b-87fb7290a7b4 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:16 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-194d89c4-72dc-434c-9c8b-87fb7290a7b4 Sep 10 20:02:16 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-060d38c9-efad-438f-a7b8-c52fc3841d40 tempest-CreateVolumesFromImageTest-928311851 None] Acquiring lock "cinder-f7aac6f8-f78b-469d-a031-43270e97a9f1-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-060d38c9-efad-438f-a7b8-c52fc3841d40 tempest-CreateVolumesFromImageTest-928311851 None] Lock "cinder-f7aac6f8-f78b-469d-a031-43270e97a9f1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:16 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-17b714dd-1e1d-414c-9685-8b9a6268dd13 tempest-CreateVolumesFromImageTest-928311851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.332s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-17b714dd-1e1d-414c-9685-8b9a6268dd13 tempest-CreateVolumesFromImageTest-928311851 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:02:16 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-17b714dd-1e1d-414c-9685-8b9a6268dd13 tempest-CreateVolumesFromImageTest-928311851 None] Deleted volume successfully. Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-060d38c9-efad-438f-a7b8-c52fc3841d40 tempest-CreateVolumesFromImageTest-928311851 None] Acquiring lock "cinder-quobyte-f7aac6f8-f78b-469d-a031-43270e97a9f1" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-060d38c9-efad-438f-a7b8-c52fc3841d40 tempest-CreateVolumesFromImageTest-928311851 None] Lock "cinder-quobyte-f7aac6f8-f78b-469d-a031-43270e97a9f1" acquired by "delete_volume" :: waited 0.023s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-17b714dd-1e1d-414c-9685-8b9a6268dd13 tempest-CreateVolumesFromImageTest-928311851 None] Lock "cinder-9a60fcb7-5d98-4f2a-bf0c-fee7b9127249-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0d42e9-21cf-4323-aea0-2c4dfa8f159c]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-060d38c9-efad-438f-a7b8-c52fc3841d40 tempest-CreateVolumesFromImageTest-928311851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f7aac6f8-f78b-469d-a031-43270e97a9f1 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ccf4a9bd-1df3-47b0-b13b-45ccd8576ece tempest-CinderUnicodeTest-727280680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:16 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-194d89c4-72dc-434c-9c8b-87fb7290a7b4" returned: 0 in 0.355s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.686s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Acquiring lock "cinder-quobyte-1ac05a4a-faac-43af-bb87-f90df1174a8d-7327e40d-666f-4487-b96b-022355e9042a" by "_create_volume_from_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Lock "cinder-quobyte-1ac05a4a-faac-43af-bb87-f90df1174a8d-7327e40d-666f-4487-b96b-022355e9042a" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Creating volume 7327e40d-666f-4487-b96b-022355e9042a from snapshot 1ac05a4a-faac-43af-bb87-f90df1174a8d {{(pid=88093) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Acquiring lock "cinder-quobyte-7327e40d-666f-4487-b96b-022355e9042a" by "_copy_volume_from_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG cinder.volume.volume_utils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Attempting download of 55abd4b7-8ce2-4fdc-962f-fead13234174 ((None, [{'url': 'file:///opt/stack/data/glance/images/55abd4b7-8ce2-4fdc-962f-fead13234174', 'metadata': {}}])) to volume 194d89c4-72dc-434c-9c8b-87fb7290a7b4. {{(pid=88093) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Lock "cinder-quobyte-7327e40d-666f-4487-b96b-022355e9042a" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] snapshot: 1ac05a4a-faac-43af-bb87-f90df1174a8d, volume: 7327e40d-666f-4487-b96b-022355e9042a, {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 20:02:16 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f7aac6f8-f78b-469d-a031-43270e97a9f1 Sep 10 20:02:16 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ef5587-429d-4915-8475-1982dc12247e]: (4, 'raw') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55abd4b7-8ce2-4fdc-962f-fead13234174_x5ps3lz4 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0c4002-9877-4580-bac4-47224dfbc293]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246.1ac05a4a-faac-43af-bb87-f90df1174a8d {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:16 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55abd4b7-8ce2-4fdc-962f-fead13234174_x5ps3lz4 Sep 10 20:02:16 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:16 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246.1ac05a4a-faac-43af-bb87-f90df1174a8d Sep 10 20:02:16 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:17 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-060d38c9-efad-438f-a7b8-c52fc3841d40 tempest-CreateVolumesFromImageTest-928311851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f7aac6f8-f78b-469d-a031-43270e97a9f1" returned: 0 in 0.466s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-060d38c9-efad-438f-a7b8-c52fc3841d40 tempest-CreateVolumesFromImageTest-928311851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f7aac6f8-f78b-469d-a031-43270e97a9f1 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:17 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f7aac6f8-f78b-469d-a031-43270e97a9f1 Sep 10 20:02:17 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:17 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55abd4b7-8ce2-4fdc-962f-fead13234174_x5ps3lz4" returned: 0 in 0.366s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55abd4b7-8ce2-4fdc-962f-fead13234174_x5ps3lz4 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:17 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246.1ac05a4a-faac-43af-bb87-f90df1174a8d" returned: 0 in 0.394s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42a5bb6d-077a-4011-8c4e-7dee1676d246(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c60bb8-72f4-4760-bf82-0fc09bf12f46]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:17 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55abd4b7-8ce2-4fdc-962f-fead13234174_x5ps3lz4 Sep 10 20:02:17 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:17 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-060d38c9-efad-438f-a7b8-c52fc3841d40 tempest-CreateVolumesFromImageTest-928311851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f7aac6f8-f78b-469d-a031-43270e97a9f1" returned: 0 in 0.258s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:17 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246 Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-060d38c9-efad-438f-a7b8-c52fc3841d40 tempest-CreateVolumesFromImageTest-928311851 None] Lock "cinder-quobyte-f7aac6f8-f78b-469d-a031-43270e97a9f1" released by "delete_volume" :: held 0.787s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:17 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-060d38c9-efad-438f-a7b8-c52fc3841d40 tempest-CreateVolumesFromImageTest-928311851 None] Created reservations ['866ba15d-ebd6-4fe0-a6c6-caa4990f5c47', '32bcd449-a7c3-4488-a26e-b0ffe8d57b46', 'df3c6eff-d513-45e1-9fe0-b1237e7bc2a8', '6b43b952-38e5-40eb-a2da-0ddcb84d290a'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-060d38c9-efad-438f-a7b8-c52fc3841d40 tempest-CreateVolumesFromImageTest-928311851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-060d38c9-efad-438f-a7b8-c52fc3841d40 tempest-CreateVolumesFromImageTest-928311851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-060d38c9-efad-438f-a7b8-c52fc3841d40 tempest-CreateVolumesFromImageTest-928311851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-060d38c9-efad-438f-a7b8-c52fc3841d40 tempest-CreateVolumesFromImageTest-928311851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-060d38c9-efad-438f-a7b8-c52fc3841d40 tempest-CreateVolumesFromImageTest-928311851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-060d38c9-efad-438f-a7b8-c52fc3841d40 tempest-CreateVolumesFromImageTest-928311851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:17 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:02:17 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:17 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55abd4b7-8ce2-4fdc-962f-fead13234174_x5ps3lz4" returned: 1 in 0.362s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55abd4b7-8ce2-4fdc-962f-fead13234174_x5ps3lz4' failed. Not Retrying. {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f81f927-d951-40c1-a24d-afe55f352aca]: (4, 'raw') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55abd4b7-8ce2-4fdc-962f-fead13234174_cj9mqdi3devstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:17 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55abd4b7-8ce2-4fdc-962f-fead13234174_cj9mqdi3devstack@QuobyteHD Sep 10 20:02:17 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ad27f93f-fe8e-4fe9-ba17-66a9fefb5185 tempest-CreateVolumesFromImageTest-928311851 None] Acquiring lock "cinder-c1c4b2c7-1fb6-466c-85c1-5b08039fa446-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:17 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246" returned: 0 in 0.473s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246 {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Creating direct copy from snapshot {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG cinder.utils [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Path /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7327e40d-666f-4487-b96b-022355e9042a not found in is_blk_device check {{(pid=88093) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7327e40d-666f-4487-b96b-022355e9042a {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ad27f93f-fe8e-4fe9-ba17-66a9fefb5185 tempest-CreateVolumesFromImageTest-928311851 None] Lock "cinder-c1c4b2c7-1fb6-466c-85c1-5b08039fa446-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:17 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7327e40d-666f-4487-b96b-022355e9042a Sep 10 20:02:17 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ad27f93f-fe8e-4fe9-ba17-66a9fefb5185 tempest-CreateVolumesFromImageTest-928311851 None] Acquiring lock "cinder-quobyte-c1c4b2c7-1fb6-466c-85c1-5b08039fa446" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ad27f93f-fe8e-4fe9-ba17-66a9fefb5185 tempest-CreateVolumesFromImageTest-928311851 None] Lock "cinder-quobyte-c1c4b2c7-1fb6-466c-85c1-5b08039fa446" acquired by "delete_volume" :: waited 0.024s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd993b9-a62c-4d0f-8b9b-4cd3f31a056c]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad27f93f-fe8e-4fe9-ba17-66a9fefb5185 tempest-CreateVolumesFromImageTest-928311851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c1c4b2c7-1fb6-466c-85c1-5b08039fa446 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:17 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-060d38c9-efad-438f-a7b8-c52fc3841d40 tempest-CreateVolumesFromImageTest-928311851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.369s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-060d38c9-efad-438f-a7b8-c52fc3841d40 tempest-CreateVolumesFromImageTest-928311851 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:02:17 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-060d38c9-efad-438f-a7b8-c52fc3841d40 tempest-CreateVolumesFromImageTest-928311851 None] Deleted volume successfully. Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-060d38c9-efad-438f-a7b8-c52fc3841d40 tempest-CreateVolumesFromImageTest-928311851 None] Lock "cinder-f7aac6f8-f78b-469d-a031-43270e97a9f1-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:17 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55abd4b7-8ce2-4fdc-962f-fead13234174_cj9mqdi3devstack@QuobyteHD" returned: 0 in 0.382s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55abd4b7-8ce2-4fdc-962f-fead13234174_cj9mqdi3devstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:17 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c1c4b2c7-1fb6-466c-85c1-5b08039fa446 Sep 10 20:02:17 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:17 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55abd4b7-8ce2-4fdc-962f-fead13234174_cj9mqdi3devstack@QuobyteHD Sep 10 20:02:17 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:18 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55abd4b7-8ce2-4fdc-962f-fead13234174_cj9mqdi3devstack@QuobyteHD" returned: 1 in 0.406s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55abd4b7-8ce2-4fdc-962f-fead13234174_cj9mqdi3devstack@QuobyteHD' failed. Not Retrying. {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:02:18 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] 55abd4b7-8ce2-4fdc-962f-fead13234174 was raw, converting to qcow2 {{(pid=88093) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 20:02:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_55abd4b7-8ce2-4fdc-962f-fead13234174_cj9mqdi3devstack@QuobyteHD /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-194d89c4-72dc-434c-9c8b-87fb7290a7b4 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:18 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_55abd4b7-8ce2-4fdc-962f-fead13234174_cj9mqdi3devstack@QuobyteHD /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-194d89c4-72dc-434c-9c8b-87fb7290a7b4 Sep 10 20:02:18 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:18 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad27f93f-fe8e-4fe9-ba17-66a9fefb5185 tempest-CreateVolumesFromImageTest-928311851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c1c4b2c7-1fb6-466c-85c1-5b08039fa446" returned: 0 in 0.605s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad27f93f-fe8e-4fe9-ba17-66a9fefb5185 tempest-CreateVolumesFromImageTest-928311851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c1c4b2c7-1fb6-466c-85c1-5b08039fa446 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:18 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c1c4b2c7-1fb6-466c-85c1-5b08039fa446 Sep 10 20:02:18 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:18 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad27f93f-fe8e-4fe9-ba17-66a9fefb5185 tempest-CreateVolumesFromImageTest-928311851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c1c4b2c7-1fb6-466c-85c1-5b08039fa446" returned: 0 in 0.581s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:19 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ad27f93f-fe8e-4fe9-ba17-66a9fefb5185 tempest-CreateVolumesFromImageTest-928311851 None] Lock "cinder-quobyte-c1c4b2c7-1fb6-466c-85c1-5b08039fa446" released by "delete_volume" :: held 1.270s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:19 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-ad27f93f-fe8e-4fe9-ba17-66a9fefb5185 tempest-CreateVolumesFromImageTest-928311851 None] Created reservations ['22dfc02e-970d-4c9d-b82c-86658cade1f6', '0d4e92d6-6422-4f32-b30b-cae1e6f6943d', '26e5973e-6307-4d23-811a-209378a074a8', 'c21a10f2-3b1e-49d1-aa83-f04a9df9e07d'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:02:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ad27f93f-fe8e-4fe9-ba17-66a9fefb5185 tempest-CreateVolumesFromImageTest-928311851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ad27f93f-fe8e-4fe9-ba17-66a9fefb5185 tempest-CreateVolumesFromImageTest-928311851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:19 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ad27f93f-fe8e-4fe9-ba17-66a9fefb5185 tempest-CreateVolumesFromImageTest-928311851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:19 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ad27f93f-fe8e-4fe9-ba17-66a9fefb5185 tempest-CreateVolumesFromImageTest-928311851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ad27f93f-fe8e-4fe9-ba17-66a9fefb5185 tempest-CreateVolumesFromImageTest-928311851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad27f93f-fe8e-4fe9-ba17-66a9fefb5185 tempest-CreateVolumesFromImageTest-928311851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:19 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:02:19 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:19 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_55abd4b7-8ce2-4fdc-962f-fead13234174_cj9mqdi3devstack@QuobyteHD /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-194d89c4-72dc-434c-9c8b-87fb7290a7b4" returned: 0 in 1.118s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:19 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_55abd4b7-8ce2-4fdc-962f-fead13234174_cj9mqdi3devstack@QuobyteHD, size 0.00 MB, duration 1.12 sec, destination /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-194d89c4-72dc-434c-9c8b-87fb7290a7b4 {{(pid=88093) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 20:02:19 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Converted 0.00 MB image at 0.00 MB/s Sep 10 20:02:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-194d89c4-72dc-434c-9c8b-87fb7290a7b4 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:19 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-194d89c4-72dc-434c-9c8b-87fb7290a7b4 1G Sep 10 20:02:19 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:19 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad27f93f-fe8e-4fe9-ba17-66a9fefb5185 tempest-CreateVolumesFromImageTest-928311851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.509s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:19 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-ad27f93f-fe8e-4fe9-ba17-66a9fefb5185 tempest-CreateVolumesFromImageTest-928311851 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:02:19 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-ad27f93f-fe8e-4fe9-ba17-66a9fefb5185 tempest-CreateVolumesFromImageTest-928311851 None] Deleted volume successfully. Sep 10 20:02:19 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ad27f93f-fe8e-4fe9-ba17-66a9fefb5185 tempest-CreateVolumesFromImageTest-928311851 None] Lock "cinder-c1c4b2c7-1fb6-466c-85c1-5b08039fa446-delete_volume" released by "delete_volume" :: held 2.220s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:20 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-6634da1e-4f8c-4719-8911-5ccbda7e5347 tempest-CreateVolumesFromImageTest-928311851 None] Acquiring lock "cinder-061561dc-be5c-4fcc-9b82-998f781bf7ec-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:20 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-6634da1e-4f8c-4719-8911-5ccbda7e5347 tempest-CreateVolumesFromImageTest-928311851 None] Lock "cinder-061561dc-be5c-4fcc-9b82-998f781bf7ec-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:20 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-6634da1e-4f8c-4719-8911-5ccbda7e5347 tempest-CreateVolumesFromImageTest-928311851 None] Acquiring lock "cinder-quobyte-061561dc-be5c-4fcc-9b82-998f781bf7ec" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:20 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-6634da1e-4f8c-4719-8911-5ccbda7e5347 tempest-CreateVolumesFromImageTest-928311851 None] Lock "cinder-quobyte-061561dc-be5c-4fcc-9b82-998f781bf7ec" acquired by "delete_volume" :: waited 0.033s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:20 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[a884b6c6-2117-45a6-a210-3daf614b017f]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6634da1e-4f8c-4719-8911-5ccbda7e5347 tempest-CreateVolumesFromImageTest-928311851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-061561dc-be5c-4fcc-9b82-998f781bf7ec {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:20 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-194d89c4-72dc-434c-9c8b-87fb7290a7b4 1G" returned: 0 in 1.275s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:20 devstack cinder-volume[88093]: DEBUG cinder.volume.volume_utils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Downloaded image 55abd4b7-8ce2-4fdc-962f-fead13234174 ((None, [{'url': 'file:///opt/stack/data/glance/images/55abd4b7-8ce2-4fdc-962f-fead13234174', 'metadata': {}}])) to volume 194d89c4-72dc-434c-9c8b-87fb7290a7b4 successfully. {{(pid=88093) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 20:02:20 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Temporary image 55abd4b7-8ce2-4fdc-962f-fead13234174 for user 5d9bd317159c43aa8f293ae24f0d5785 is deleted. {{(pid=88093) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 20:02:20 devstack cinder-volume[88093]: DEBUG cinder.volume.volume_utils [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Marking volume 194d89c4-72dc-434c-9c8b-87fb7290a7b4 as bootable. {{(pid=88093) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 20:02:20 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Copying metadata from image 55abd4b7-8ce2-4fdc-962f-fead13234174 to 194d89c4-72dc-434c-9c8b-87fb7290a7b4. {{(pid=88093) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 20:02:20 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Creating volume glance metadata for volume 194d89c4-72dc-434c-9c8b-87fb7290a7b4 backed by image 55abd4b7-8ce2-4fdc-962f-fead13234174 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '55abd4b7-8ce2-4fdc-962f-fead13234174', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '4a7fcfffe555041e63a08cd9a23388fe', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88093) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 20:02:20 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-061561dc-be5c-4fcc-9b82-998f781bf7ec Sep 10 20:02:20 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fd724fc-e0ff-4036-8b78-831febe6e2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-194d89c4-72dc-434c-9c8b-87fb7290a7b4', 'volume_size': 1, 'image_id': '55abd4b7-8ce2-4fdc-962f-fead13234174', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55abd4b7-8ce2-4fdc-962f-fead13234174', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4a7fcfffe555041e63a08cd9a23388fe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '45f72b73f3f946f6b83f805fada2dcac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6694e9d9a01fef67095a7d594ead3b9c471d991637546b29cef0249ba25627af634d43e2fac4d70a50590d6fd02bf42e0aed4b102bc8165393af9f435ccc792b', 'id': '55abd4b7-8ce2-4fdc-962f-fead13234174', 'created_at': datetime.datetime(2026, 9, 10, 18, 2, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 18, 2, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55abd4b7-8ce2-4fdc-962f-fead13234174/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd17c36-e55e-4771-b4ea-04b67e40989e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:21 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Volume volume-194d89c4-72dc-434c-9c8b-87fb7290a7b4 (194d89c4-72dc-434c-9c8b-87fb7290a7b4): created successfully Sep 10 20:02:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd17c36-e55e-4771-b4ea-04b67e40989e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Flow 'volume_create_manager' (920c006d-275b-45c1-9988-0fef71a6a0ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:21 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-f75d68ea-386c-4881-87da-3eef76f8a641 tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Created volume successfully. Sep 10 20:02:21 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6634da1e-4f8c-4719-8911-5ccbda7e5347 tempest-CreateVolumesFromImageTest-928311851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-061561dc-be5c-4fcc-9b82-998f781bf7ec" returned: 0 in 1.148s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6634da1e-4f8c-4719-8911-5ccbda7e5347 tempest-CreateVolumesFromImageTest-928311851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-061561dc-be5c-4fcc-9b82-998f781bf7ec {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:21 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-061561dc-be5c-4fcc-9b82-998f781bf7ec Sep 10 20:02:21 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:21 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-afab9e8e-bc63-4ba1-bbc2-23bf830b4a7b tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Acquiring lock "cinder-194d89c4-72dc-434c-9c8b-87fb7290a7b4-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:21 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-afab9e8e-bc63-4ba1-bbc2-23bf830b4a7b tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Lock "cinder-194d89c4-72dc-434c-9c8b-87fb7290a7b4-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:21 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-afab9e8e-bc63-4ba1-bbc2-23bf830b4a7b tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Acquiring lock "cinder-quobyte-194d89c4-72dc-434c-9c8b-87fb7290a7b4" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:21 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-afab9e8e-bc63-4ba1-bbc2-23bf830b4a7b tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Lock "cinder-quobyte-194d89c4-72dc-434c-9c8b-87fb7290a7b4" acquired by "delete_volume" :: waited 0.049s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:22 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[6377a04a-05c5-4e2a-9db7-e651ad549c66]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-afab9e8e-bc63-4ba1-bbc2-23bf830b4a7b tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-194d89c4-72dc-434c-9c8b-87fb7290a7b4 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:22 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6634da1e-4f8c-4719-8911-5ccbda7e5347 tempest-CreateVolumesFromImageTest-928311851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-061561dc-be5c-4fcc-9b82-998f781bf7ec" returned: 0 in 0.714s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:22 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-6634da1e-4f8c-4719-8911-5ccbda7e5347 tempest-CreateVolumesFromImageTest-928311851 None] Lock "cinder-quobyte-061561dc-be5c-4fcc-9b82-998f781bf7ec" released by "delete_volume" :: held 1.992s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:22 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-194d89c4-72dc-434c-9c8b-87fb7290a7b4 Sep 10 20:02:22 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:22 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-6634da1e-4f8c-4719-8911-5ccbda7e5347 tempest-CreateVolumesFromImageTest-928311851 None] Created reservations ['4072bd44-945d-4b5f-90e9-bcf492f277f2', 'd069df3c-3be2-4aa9-9fa9-81e1d68ed626', '0b3e17d0-f89c-4a7b-8e08-e16ab4c3b564', 'b06ccf53-5a00-4c3f-ad73-28b036996964'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:02:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6634da1e-4f8c-4719-8911-5ccbda7e5347 tempest-CreateVolumesFromImageTest-928311851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6634da1e-4f8c-4719-8911-5ccbda7e5347 tempest-CreateVolumesFromImageTest-928311851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:22 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6634da1e-4f8c-4719-8911-5ccbda7e5347 tempest-CreateVolumesFromImageTest-928311851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:22 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6634da1e-4f8c-4719-8911-5ccbda7e5347 tempest-CreateVolumesFromImageTest-928311851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6634da1e-4f8c-4719-8911-5ccbda7e5347 tempest-CreateVolumesFromImageTest-928311851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6634da1e-4f8c-4719-8911-5ccbda7e5347 tempest-CreateVolumesFromImageTest-928311851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:22 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:02:22 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:23 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-afab9e8e-bc63-4ba1-bbc2-23bf830b4a7b tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-194d89c4-72dc-434c-9c8b-87fb7290a7b4" returned: 0 in 1.043s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-afab9e8e-bc63-4ba1-bbc2-23bf830b4a7b tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-194d89c4-72dc-434c-9c8b-87fb7290a7b4 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:23 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-194d89c4-72dc-434c-9c8b-87fb7290a7b4 Sep 10 20:02:23 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:23 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7327e40d-666f-4487-b96b-022355e9042a" returned: 0 in 5.485s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Image conversion details: src /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246, size 1024.00 MB, duration 5.49 sec, destination /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7327e40d-666f-4487-b96b-022355e9042a {{(pid=88093) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 20:02:23 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Converted 1024.00 MB image at 186.62 MB/s Sep 10 20:02:23 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7327e40d-666f-4487-b96b-022355e9042a is being set with open permissions: ugo+rw Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7327e40d-666f-4487-b96b-022355e9042a {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:23 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7327e40d-666f-4487-b96b-022355e9042a Sep 10 20:02:23 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:23 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6634da1e-4f8c-4719-8911-5ccbda7e5347 tempest-CreateVolumesFromImageTest-928311851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.513s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-6634da1e-4f8c-4719-8911-5ccbda7e5347 tempest-CreateVolumesFromImageTest-928311851 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:02:23 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-6634da1e-4f8c-4719-8911-5ccbda7e5347 tempest-CreateVolumesFromImageTest-928311851 None] Deleted volume successfully. Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-6634da1e-4f8c-4719-8911-5ccbda7e5347 tempest-CreateVolumesFromImageTest-928311851 None] Lock "cinder-061561dc-be5c-4fcc-9b82-998f781bf7ec-delete_volume" released by "delete_volume" :: held 3.071s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:23 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-afab9e8e-bc63-4ba1-bbc2-23bf830b4a7b tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-194d89c4-72dc-434c-9c8b-87fb7290a7b4" returned: 0 in 0.285s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-afab9e8e-bc63-4ba1-bbc2-23bf830b4a7b tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Lock "cinder-quobyte-194d89c4-72dc-434c-9c8b-87fb7290a7b4" released by "delete_volume" :: held 1.411s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-afab9e8e-bc63-4ba1-bbc2-23bf830b4a7b tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Created reservations ['bd736687-2aab-42d5-b771-7b90ac554586', '7dec3bb4-acc3-4320-ac7a-7128d402c9ac', '5305ce51-c0ad-4c9e-92d8-69e859a0a3fb', '7c44918d-f1b4-4579-a5ec-76b8d9621337'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:02:23 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7327e40d-666f-4487-b96b-022355e9042a" returned: 0 in 0.318s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Lock "cinder-quobyte-7327e40d-666f-4487-b96b-022355e9042a" released by "_copy_volume_from_snapshot" :: held 6.802s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-afab9e8e-bc63-4ba1-bbc2-23bf830b4a7b tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-afab9e8e-bc63-4ba1-bbc2-23bf830b4a7b tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-afab9e8e-bc63-4ba1-bbc2-23bf830b4a7b tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-afab9e8e-bc63-4ba1-bbc2-23bf830b4a7b tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-afab9e8e-bc63-4ba1-bbc2-23bf830b4a7b tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-afab9e8e-bc63-4ba1-bbc2-23bf830b4a7b tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Lock "cinder-quobyte-1ac05a4a-faac-43af-bb87-f90df1174a8d-7327e40d-666f-4487-b96b-022355e9042a" released by "_create_volume_from_snapshot" :: held 6.914s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.938s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ccf4a9bd-1df3-47b0-b13b-45ccd8576ece tempest-CinderUnicodeTest-727280680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.975s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:23 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:02:23 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-ccf4a9bd-1df3-47b0-b13b-45ccd8576ece tempest-CinderUnicodeTest-727280680 None] Creating offline snapshot 2a7aa7e9-dbec-4fce-88b7-53ec179261fa of volume 7ef53227-86f0-4ecc-8626-1ca253764db4 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65cc523c-3469-4189-9dda-2e2e7d8aa928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7327e40d-666f-4487-b96b-022355e9042a', 'volume_size': 1, 'snapshot_id': '1ac05a4a-faac-43af-bb87-f90df1174a8d'}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60cbb292-4271-436f-aa51-d521d28008e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[518b2bf3-d2c9-4c2a-ad0a-c0b159a5ba9e]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ccf4a9bd-1df3-47b0-b13b-45ccd8576ece tempest-CinderUnicodeTest-727280680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:23 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Volume volume-7327e40d-666f-4487-b96b-022355e9042a (7327e40d-666f-4487-b96b-022355e9042a): created successfully Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60cbb292-4271-436f-aa51-d521d28008e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Flow 'volume_create_manager' (61e31ce8-f222-40c4-b4eb-b36cb11f2916) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:23 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-1b48829c-c470-45ae-aa3d-d43549e95500 tempest-VolumeDependencyTests-199317518 None] Created volume successfully. Sep 10 20:02:23 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4 Sep 10 20:02:23 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-45c9f574-3de7-4fd9-a061-762e9968e401 tempest-VolumeDependencyTests-199317518 None] Acquiring lock "cinder-1ac05a4a-faac-43af-bb87-f90df1174a8d-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-45c9f574-3de7-4fd9-a061-762e9968e401 tempest-VolumeDependencyTests-199317518 None] Lock "cinder-1ac05a4a-faac-43af-bb87-f90df1174a8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-45c9f574-3de7-4fd9-a061-762e9968e401 tempest-VolumeDependencyTests-199317518 None] Acquiring lock "cinder-quobyte-42a5bb6d-077a-4011-8c4e-7dee1676d246" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-45c9f574-3de7-4fd9-a061-762e9968e401 tempest-VolumeDependencyTests-199317518 None] Lock "cinder-quobyte-42a5bb6d-077a-4011-8c4e-7dee1676d246" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-45c9f574-3de7-4fd9-a061-762e9968e401 tempest-VolumeDependencyTests-199317518 None] Acquiring lock "cinder-quobyte-1ac05a4a-faac-43af-bb87-f90df1174a8d" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:23 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-afab9e8e-bc63-4ba1-bbc2-23bf830b4a7b tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.370s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-afab9e8e-bc63-4ba1-bbc2-23bf830b4a7b tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:02:23 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-afab9e8e-bc63-4ba1-bbc2-23bf830b4a7b tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Deleted volume successfully. Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-45c9f574-3de7-4fd9-a061-762e9968e401 tempest-VolumeDependencyTests-199317518 None] Lock "cinder-quobyte-1ac05a4a-faac-43af-bb87-f90df1174a8d" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-45c9f574-3de7-4fd9-a061-762e9968e401 tempest-VolumeDependencyTests-199317518 None] Deleting offline snapshot 1ac05a4a-faac-43af-bb87-f90df1174a8d of volume 42a5bb6d-077a-4011-8c4e-7dee1676d246 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-45c9f574-3de7-4fd9-a061-762e9968e401 tempest-VolumeDependencyTests-199317518 None] snapshot_file for this snap is: volume-42a5bb6d-077a-4011-8c4e-7dee1676d246.1ac05a4a-faac-43af-bb87-f90df1174a8d {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[134ff17b-3a20-4d6b-af74-df1c5706f4fb]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-45c9f574-3de7-4fd9-a061-762e9968e401 tempest-VolumeDependencyTests-199317518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246.1ac05a4a-faac-43af-bb87-f90df1174a8d {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:24 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-afab9e8e-bc63-4ba1-bbc2-23bf830b4a7b tempest-VolumeAndVolumeTypeFromImageTest-1683137685 None] Lock "cinder-194d89c4-72dc-434c-9c8b-87fb7290a7b4-delete_volume" released by "delete_volume" :: held 2.179s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:24 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246.1ac05a4a-faac-43af-bb87-f90df1174a8d Sep 10 20:02:24 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:24 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ccf4a9bd-1df3-47b0-b13b-45ccd8576ece tempest-CinderUnicodeTest-727280680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4" returned: 0 in 0.516s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ccf4a9bd-1df3-47b0-b13b-45ccd8576ece tempest-CinderUnicodeTest-727280680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4.2a7aa7e9-dbec-4fce-88b7-53ec179261fa 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:24 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4.2a7aa7e9-dbec-4fce-88b7-53ec179261fa 1G Sep 10 20:02:24 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:24 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-45c9f574-3de7-4fd9-a061-762e9968e401 tempest-VolumeDependencyTests-199317518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246.1ac05a4a-faac-43af-bb87-f90df1174a8d" returned: 0 in 0.520s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:24 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-45c9f574-3de7-4fd9-a061-762e9968e401 tempest-VolumeDependencyTests-199317518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42a5bb6d-077a-4011-8c4e-7dee1676d246(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:02:24 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[36af7b99-c387-418e-b77d-9554af77e419]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-45c9f574-3de7-4fd9-a061-762e9968e401 tempest-VolumeDependencyTests-199317518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:24 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246 Sep 10 20:02:24 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:24 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ccf4a9bd-1df3-47b0-b13b-45ccd8576ece tempest-CinderUnicodeTest-727280680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4.2a7aa7e9-dbec-4fce-88b7-53ec179261fa 1G" returned: 0 in 0.745s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ccf4a9bd-1df3-47b0-b13b-45ccd8576ece tempest-CinderUnicodeTest-727280680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ef53227-86f0-4ecc-8626-1ca253764db4 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4.2a7aa7e9-dbec-4fce-88b7-53ec179261fa {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:24 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ef53227-86f0-4ecc-8626-1ca253764db4 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4.2a7aa7e9-dbec-4fce-88b7-53ec179261fa Sep 10 20:02:24 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:25 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ccf4a9bd-1df3-47b0-b13b-45ccd8576ece tempest-CinderUnicodeTest-727280680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ef53227-86f0-4ecc-8626-1ca253764db4 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4.2a7aa7e9-dbec-4fce-88b7-53ec179261fa" returned: 0 in 0.443s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:25 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-ccf4a9bd-1df3-47b0-b13b-45ccd8576ece tempest-CinderUnicodeTest-727280680 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4.2a7aa7e9-dbec-4fce-88b7-53ec179261fa is being set with open permissions: ugo+rw Sep 10 20:02:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ccf4a9bd-1df3-47b0-b13b-45ccd8576ece tempest-CinderUnicodeTest-727280680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4.2a7aa7e9-dbec-4fce-88b7-53ec179261fa {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:25 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-45c9f574-3de7-4fd9-a061-762e9968e401 tempest-VolumeDependencyTests-199317518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246" returned: 0 in 0.812s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-45c9f574-3de7-4fd9-a061-762e9968e401 tempest-VolumeDependencyTests-199317518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246.1ac05a4a-faac-43af-bb87-f90df1174a8d {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:25 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4.2a7aa7e9-dbec-4fce-88b7-53ec179261fa Sep 10 20:02:25 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:25 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246.1ac05a4a-faac-43af-bb87-f90df1174a8d Sep 10 20:02:25 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:25 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ccf4a9bd-1df3-47b0-b13b-45ccd8576ece tempest-CinderUnicodeTest-727280680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4.2a7aa7e9-dbec-4fce-88b7-53ec179261fa" returned: 0 in 0.340s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ccf4a9bd-1df3-47b0-b13b-45ccd8576ece tempest-CinderUnicodeTest-727280680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:25 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4.info Sep 10 20:02:25 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:25 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-45c9f574-3de7-4fd9-a061-762e9968e401 tempest-VolumeDependencyTests-199317518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246.1ac05a4a-faac-43af-bb87-f90df1174a8d" returned: 0 in 0.436s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-45c9f574-3de7-4fd9-a061-762e9968e401 tempest-VolumeDependencyTests-199317518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246.1ac05a4a-faac-43af-bb87-f90df1174a8d {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:25 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246.1ac05a4a-faac-43af-bb87-f90df1174a8d Sep 10 20:02:25 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:26 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ccf4a9bd-1df3-47b0-b13b-45ccd8576ece tempest-CinderUnicodeTest-727280680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4.info" returned: 0 in 0.394s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:26 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-ccf4a9bd-1df3-47b0-b13b-45ccd8576ece tempest-CinderUnicodeTest-727280680 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4.info is being set with open permissions: ugo+rw Sep 10 20:02:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ccf4a9bd-1df3-47b0-b13b-45ccd8576ece tempest-CinderUnicodeTest-727280680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:26 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4.info Sep 10 20:02:26 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:26 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-45c9f574-3de7-4fd9-a061-762e9968e401 tempest-VolumeDependencyTests-199317518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246.1ac05a4a-faac-43af-bb87-f90df1174a8d" returned: 0 in 0.440s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:26 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-45c9f574-3de7-4fd9-a061-762e9968e401 tempest-VolumeDependencyTests-199317518 None] Lock "cinder-quobyte-1ac05a4a-faac-43af-bb87-f90df1174a8d" released by "_delete_snapshot" :: held 2.361s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:26 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-45c9f574-3de7-4fd9-a061-762e9968e401 tempest-VolumeDependencyTests-199317518 None] Lock "cinder-quobyte-42a5bb6d-077a-4011-8c4e-7dee1676d246" released by "delete_snapshot" :: held 2.405s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:26 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-45c9f574-3de7-4fd9-a061-762e9968e401 tempest-VolumeDependencyTests-199317518 None] Created reservations ['b57e1c76-a5aa-47ad-a08a-560503b9204f', '642a67ce-1a4e-480a-88ac-65e9bfcb927b', '954da35d-4d92-4e44-a6f0-b8d065670e57', '6d49d869-9e64-4c17-b350-3e3823237fe3'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:02:26 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-45c9f574-3de7-4fd9-a061-762e9968e401 tempest-VolumeDependencyTests-199317518 None] Delete snapshot completed successfully. Sep 10 20:02:26 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-45c9f574-3de7-4fd9-a061-762e9968e401 tempest-VolumeDependencyTests-199317518 None] Lock "cinder-1ac05a4a-faac-43af-bb87-f90df1174a8d-delete_snapshot" released by "delete_snapshot" :: held 2.614s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:26 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ccf4a9bd-1df3-47b0-b13b-45ccd8576ece tempest-CinderUnicodeTest-727280680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4.info" returned: 0 in 0.401s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ccf4a9bd-1df3-47b0-b13b-45ccd8576ece tempest-CinderUnicodeTest-727280680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.991s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:26 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-ccf4a9bd-1df3-47b0-b13b-45ccd8576ece tempest-CinderUnicodeTest-727280680 None] Create snapshot completed successfully Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-6c9fd429-d1fc-434e-b430-c9f8e1ae90ee tempest-VolumeDependencyTests-199317518 None] Acquiring lock "cinder-42a5bb6d-077a-4011-8c4e-7dee1676d246-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-6c9fd429-d1fc-434e-b430-c9f8e1ae90ee tempest-VolumeDependencyTests-199317518 None] Lock "cinder-42a5bb6d-077a-4011-8c4e-7dee1676d246-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-6c9fd429-d1fc-434e-b430-c9f8e1ae90ee tempest-VolumeDependencyTests-199317518 None] Acquiring lock "cinder-quobyte-42a5bb6d-077a-4011-8c4e-7dee1676d246" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-6c9fd429-d1fc-434e-b430-c9f8e1ae90ee tempest-VolumeDependencyTests-199317518 None] Lock "cinder-quobyte-42a5bb6d-077a-4011-8c4e-7dee1676d246" acquired by "delete_volume" :: waited 0.038s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bba47d2-345c-433a-b556-dc98f3e7d151]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6c9fd429-d1fc-434e-b430-c9f8e1ae90ee tempest-VolumeDependencyTests-199317518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] Flow 'volume_create_manager' (ac7337fb-9c90-4f2d-9bea-53dd7bb3ae4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c6a219-2e68-4082-a755-8d009ced271d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-69545b68-b1ac-4496-b143-14692ea5cfae tempest-CinderUnicodeTest-727280680 None] Acquiring lock "cinder-2a7aa7e9-dbec-4fce-88b7-53ec179261fa-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c6a219-2e68-4082-a755-8d009ced271d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-23063034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8837206-5363-4738-bc92-a509c06e6628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283266e15b4e4b05bbb0c16e501bc1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:27Z,use_quota=True,user_id='e2b078fd715344f3aa756755f0038edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b1e92f1-fa76-4704-9d5e-e674dfe2c06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b1e92f1-fa76-4704-9d5e-e674dfe2c06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:27 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246 Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bbe8ca1-e4c1-49fd-9306-de28b9d90202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:27 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bbe8ca1-e4c1-49fd-9306-de28b9d90202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8837206-5363-4738-bc92-a509c06e6628', 'volume_name': 'volume-d8837206-5363-4738-bc92-a509c06e6628', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade02b3e-d87d-4940-992f-8adea98b0da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade02b3e-d87d-4940-992f-8adea98b0da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c76a84db-5968-41bd-9925-44bbccbd4810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:27 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] Volume d8837206-5363-4738-bc92-a509c06e6628: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8837206-5363-4738-bc92-a509c06e6628', 'volume_size': 1} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-23063034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8837206-5363-4738-bc92-a509c06e6628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283266e15b4e4b05bbb0c16e501bc1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:27Z,use_quota=True,user_id='e2b078fd715344f3aa756755f0038edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] Creating volume d8837206-5363-4738-bc92-a509c06e6628 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:02:27 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-69545b68-b1ac-4496-b143-14692ea5cfae tempest-CinderUnicodeTest-727280680 None] Lock "cinder-2a7aa7e9-dbec-4fce-88b7-53ec179261fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.103s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-69545b68-b1ac-4496-b143-14692ea5cfae tempest-CinderUnicodeTest-727280680 None] Acquiring lock "cinder-quobyte-7ef53227-86f0-4ecc-8626-1ca253764db4" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-69545b68-b1ac-4496-b143-14692ea5cfae tempest-CinderUnicodeTest-727280680 None] Lock "cinder-quobyte-7ef53227-86f0-4ecc-8626-1ca253764db4" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-69545b68-b1ac-4496-b143-14692ea5cfae tempest-CinderUnicodeTest-727280680 None] Acquiring lock "cinder-quobyte-2a7aa7e9-dbec-4fce-88b7-53ec179261fa" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:27 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628 1073741824 Sep 10 20:02:27 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-69545b68-b1ac-4496-b143-14692ea5cfae tempest-CinderUnicodeTest-727280680 None] Lock "cinder-quobyte-2a7aa7e9-dbec-4fce-88b7-53ec179261fa" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-69545b68-b1ac-4496-b143-14692ea5cfae tempest-CinderUnicodeTest-727280680 None] Deleting offline snapshot 2a7aa7e9-dbec-4fce-88b7-53ec179261fa of volume 7ef53227-86f0-4ecc-8626-1ca253764db4 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-69545b68-b1ac-4496-b143-14692ea5cfae tempest-CinderUnicodeTest-727280680 None] snapshot_file for this snap is: volume-7ef53227-86f0-4ecc-8626-1ca253764db4.2a7aa7e9-dbec-4fce-88b7-53ec179261fa {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f8204e-7135-4627-85ae-8153ca550ffa]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-69545b68-b1ac-4496-b143-14692ea5cfae tempest-CinderUnicodeTest-727280680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4.2a7aa7e9-dbec-4fce-88b7-53ec179261fa {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:27 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4.2a7aa7e9-dbec-4fce-88b7-53ec179261fa Sep 10 20:02:27 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:27 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6c9fd429-d1fc-434e-b430-c9f8e1ae90ee tempest-VolumeDependencyTests-199317518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246" returned: 0 in 0.521s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6c9fd429-d1fc-434e-b430-c9f8e1ae90ee tempest-VolumeDependencyTests-199317518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:27 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246 Sep 10 20:02:27 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:28 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628 1073741824" returned: 0 in 0.594s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:28 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-69545b68-b1ac-4496-b143-14692ea5cfae tempest-CinderUnicodeTest-727280680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4.2a7aa7e9-dbec-4fce-88b7-53ec179261fa" returned: 0 in 0.508s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-69545b68-b1ac-4496-b143-14692ea5cfae tempest-CinderUnicodeTest-727280680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ef53227-86f0-4ecc-8626-1ca253764db4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:02:28 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4392950-750e-4178-9d3e-6f4fd09cbe23]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-69545b68-b1ac-4496-b143-14692ea5cfae tempest-CinderUnicodeTest-727280680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:28 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6c9fd429-d1fc-434e-b430-c9f8e1ae90ee tempest-VolumeDependencyTests-199317518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-42a5bb6d-077a-4011-8c4e-7dee1676d246" returned: 0 in 0.410s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:28 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628 Sep 10 20:02:28 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:28 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-6c9fd429-d1fc-434e-b430-c9f8e1ae90ee tempest-VolumeDependencyTests-199317518 None] Lock "cinder-quobyte-42a5bb6d-077a-4011-8c4e-7dee1676d246" released by "delete_volume" :: held 1.059s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:28 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4 Sep 10 20:02:28 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:28 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-6c9fd429-d1fc-434e-b430-c9f8e1ae90ee tempest-VolumeDependencyTests-199317518 None] Created reservations ['1529ab71-cfbb-430f-80a4-5c1b802df6ea', 'f514682f-a62c-44ef-8f1a-9022079c1fe2', 'efd75e8a-3e5e-48ef-b6df-f7922e52815a', 'b1fd0df6-4c6f-45da-bdc0-68e3f8814d2d'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:02:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6c9fd429-d1fc-434e-b430-c9f8e1ae90ee tempest-VolumeDependencyTests-199317518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6c9fd429-d1fc-434e-b430-c9f8e1ae90ee tempest-VolumeDependencyTests-199317518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6c9fd429-d1fc-434e-b430-c9f8e1ae90ee tempest-VolumeDependencyTests-199317518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6c9fd429-d1fc-434e-b430-c9f8e1ae90ee tempest-VolumeDependencyTests-199317518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6c9fd429-d1fc-434e-b430-c9f8e1ae90ee tempest-VolumeDependencyTests-199317518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6c9fd429-d1fc-434e-b430-c9f8e1ae90ee tempest-VolumeDependencyTests-199317518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:28 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:02:28 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:28 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628" returned: 0 in 0.340s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:02:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c76a84db-5968-41bd-9925-44bbccbd4810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8837206-5363-4738-bc92-a509c06e6628', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ab75fc-1b5a-4058-b02c-6ff98a311a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:28 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] Volume volume-d8837206-5363-4738-bc92-a509c06e6628 (d8837206-5363-4738-bc92-a509c06e6628): created successfully Sep 10 20:02:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ab75fc-1b5a-4058-b02c-6ff98a311a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] Flow 'volume_create_manager' (ac7337fb-9c90-4f2d-9bea-53dd7bb3ae4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:28 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-63293e66-5dac-4245-9ec4-234ece8cbfe4 tempest-CreateVolumesFromSnapshotTest-438369082 None] Created volume successfully. Sep 10 20:02:28 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-69545b68-b1ac-4496-b143-14692ea5cfae tempest-CinderUnicodeTest-727280680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4" returned: 0 in 0.482s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-69545b68-b1ac-4496-b143-14692ea5cfae tempest-CinderUnicodeTest-727280680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4.2a7aa7e9-dbec-4fce-88b7-53ec179261fa {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:28 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4.2a7aa7e9-dbec-4fce-88b7-53ec179261fa Sep 10 20:02:28 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:28 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6c9fd429-d1fc-434e-b430-c9f8e1ae90ee tempest-VolumeDependencyTests-199317518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.277s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:28 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-6c9fd429-d1fc-434e-b430-c9f8e1ae90ee tempest-VolumeDependencyTests-199317518 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:02:28 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-6c9fd429-d1fc-434e-b430-c9f8e1ae90ee tempest-VolumeDependencyTests-199317518 None] Deleted volume successfully. Sep 10 20:02:28 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-6c9fd429-d1fc-434e-b430-c9f8e1ae90ee tempest-VolumeDependencyTests-199317518 None] Lock "cinder-42a5bb6d-077a-4011-8c4e-7dee1676d246-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:29 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-69545b68-b1ac-4496-b143-14692ea5cfae tempest-CinderUnicodeTest-727280680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4.2a7aa7e9-dbec-4fce-88b7-53ec179261fa" returned: 0 in 0.386s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-69545b68-b1ac-4496-b143-14692ea5cfae tempest-CinderUnicodeTest-727280680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4.2a7aa7e9-dbec-4fce-88b7-53ec179261fa {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:29 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4.2a7aa7e9-dbec-4fce-88b7-53ec179261fa Sep 10 20:02:29 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:29 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-69545b68-b1ac-4496-b143-14692ea5cfae tempest-CinderUnicodeTest-727280680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4.2a7aa7e9-dbec-4fce-88b7-53ec179261fa" returned: 0 in 0.307s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:29 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ef36ec1b-4bcc-4c14-8dd1-97d85a69320f tempest-VolumeDependencyTests-199317518 None] Acquiring lock "cinder-7327e40d-666f-4487-b96b-022355e9042a-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:29 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-69545b68-b1ac-4496-b143-14692ea5cfae tempest-CinderUnicodeTest-727280680 None] Lock "cinder-quobyte-2a7aa7e9-dbec-4fce-88b7-53ec179261fa" released by "_delete_snapshot" :: held 1.865s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:29 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-69545b68-b1ac-4496-b143-14692ea5cfae tempest-CinderUnicodeTest-727280680 None] Lock "cinder-quobyte-7ef53227-86f0-4ecc-8626-1ca253764db4" released by "delete_snapshot" :: held 1.906s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:29 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ef36ec1b-4bcc-4c14-8dd1-97d85a69320f tempest-VolumeDependencyTests-199317518 None] Lock "cinder-7327e40d-666f-4487-b96b-022355e9042a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:29 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ef36ec1b-4bcc-4c14-8dd1-97d85a69320f tempest-VolumeDependencyTests-199317518 None] Acquiring lock "cinder-quobyte-7327e40d-666f-4487-b96b-022355e9042a" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:29 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ef36ec1b-4bcc-4c14-8dd1-97d85a69320f tempest-VolumeDependencyTests-199317518 None] Lock "cinder-quobyte-7327e40d-666f-4487-b96b-022355e9042a" acquired by "delete_volume" :: waited 0.029s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:29 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[d026825b-10e1-44c0-8fbb-be3e695dd110]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:29 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-69545b68-b1ac-4496-b143-14692ea5cfae tempest-CinderUnicodeTest-727280680 None] Created reservations ['c2af4b57-0e9c-4004-be1f-2d5a846a1789', '71efd915-e11d-4501-ae42-a190ee0817ad', '1d97efd7-53db-47a3-b069-07eb2d4ff88c', 'a57b0932-df01-4c26-baf1-126aaf2618ea'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:02:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ef36ec1b-4bcc-4c14-8dd1-97d85a69320f tempest-VolumeDependencyTests-199317518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7327e40d-666f-4487-b96b-022355e9042a {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0dfd9bf7-4d0e-493a-87d5-9c6b4003fd6a tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0dfd9bf7-4d0e-493a-87d5-9c6b4003fd6a tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:29 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-0dfd9bf7-4d0e-493a-87d5-9c6b4003fd6a tempest-CreateVolumesFromSnapshotTest-438369082 None] Creating offline snapshot fd893d42-d83b-4794-ba4c-73af57e38dfa of volume d8837206-5363-4738-bc92-a509c06e6628 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:02:29 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7327e40d-666f-4487-b96b-022355e9042a Sep 10 20:02:29 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:29 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3033d8-1d6c-44f8-ac7d-7f6dc81829b0]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0dfd9bf7-4d0e-493a-87d5-9c6b4003fd6a tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:29 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-69545b68-b1ac-4496-b143-14692ea5cfae tempest-CinderUnicodeTest-727280680 None] Delete snapshot completed successfully. Sep 10 20:02:29 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-69545b68-b1ac-4496-b143-14692ea5cfae tempest-CinderUnicodeTest-727280680 None] Lock "cinder-2a7aa7e9-dbec-4fce-88b7-53ec179261fa-delete_snapshot" released by "delete_snapshot" :: held 2.308s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:29 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-edc33bf6-a078-48a0-9f35-cba9d5bdf63c tempest-CinderUnicodeTest-727280680 None] Acquiring lock "cinder-7ef53227-86f0-4ecc-8626-1ca253764db4-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-edc33bf6-a078-48a0-9f35-cba9d5bdf63c tempest-CinderUnicodeTest-727280680 None] Lock "cinder-7ef53227-86f0-4ecc-8626-1ca253764db4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:30 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628 Sep 10 20:02:30 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-edc33bf6-a078-48a0-9f35-cba9d5bdf63c tempest-CinderUnicodeTest-727280680 None] Acquiring lock "cinder-quobyte-7ef53227-86f0-4ecc-8626-1ca253764db4" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-edc33bf6-a078-48a0-9f35-cba9d5bdf63c tempest-CinderUnicodeTest-727280680 None] Lock "cinder-quobyte-7ef53227-86f0-4ecc-8626-1ca253764db4" acquired by "delete_volume" :: waited 0.021s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56a5de0-c6ef-42fd-8550-6e61e9efcf34]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edc33bf6-a078-48a0-9f35-cba9d5bdf63c tempest-CinderUnicodeTest-727280680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:30 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ef36ec1b-4bcc-4c14-8dd1-97d85a69320f tempest-VolumeDependencyTests-199317518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7327e40d-666f-4487-b96b-022355e9042a" returned: 0 in 0.601s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ef36ec1b-4bcc-4c14-8dd1-97d85a69320f tempest-VolumeDependencyTests-199317518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7327e40d-666f-4487-b96b-022355e9042a {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:30 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7327e40d-666f-4487-b96b-022355e9042a Sep 10 20:02:30 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:30 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4 Sep 10 20:02:30 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:30 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0dfd9bf7-4d0e-493a-87d5-9c6b4003fd6a tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628" returned: 0 in 0.488s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0dfd9bf7-4d0e-493a-87d5-9c6b4003fd6a tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628.fd893d42-d83b-4794-ba4c-73af57e38dfa 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:30 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628.fd893d42-d83b-4794-ba4c-73af57e38dfa 1G Sep 10 20:02:30 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:30 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ef36ec1b-4bcc-4c14-8dd1-97d85a69320f tempest-VolumeDependencyTests-199317518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7327e40d-666f-4487-b96b-022355e9042a" returned: 0 in 0.352s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ef36ec1b-4bcc-4c14-8dd1-97d85a69320f tempest-VolumeDependencyTests-199317518 None] Lock "cinder-quobyte-7327e40d-666f-4487-b96b-022355e9042a" released by "delete_volume" :: held 1.038s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:30 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edc33bf6-a078-48a0-9f35-cba9d5bdf63c tempest-CinderUnicodeTest-727280680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4" returned: 0 in 0.599s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edc33bf6-a078-48a0-9f35-cba9d5bdf63c tempest-CinderUnicodeTest-727280680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:30 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4 Sep 10 20:02:30 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Flow 'volume_create_manager' (09c65c35-f2d9-40e0-81cc-324d8ee7ad1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7759280-91fa-4614-910f-a3f37b63830b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-ef36ec1b-4bcc-4c14-8dd1-97d85a69320f tempest-VolumeDependencyTests-199317518 None] Created reservations ['09c6046b-a71d-4aec-bc86-4d92e2853d27', '6ef0d554-669a-4a79-a04e-3c6e76ed8c01', 'b8da3e02-06ef-4eb4-86e4-a36f24d4dac5', '7bd3c4fc-10ad-4c8b-951b-3056ddccab55'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7759280-91fa-4614-910f-a3f37b63830b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-612044566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ede0d65-1c51-4754-87e7-6d0b304b8236,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54800cb281b41beb2b8c191b807e7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:31Z,use_quota=True,user_id='45f4efe5ac094bbdb01d6e0f4357edfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7d340b-d294-430a-8faf-2aebaf69fffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7d340b-d294-430a-8faf-2aebaf69fffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7751b64-4523-4b49-b495-e4a8ed0f5a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7751b64-4523-4b49-b495-e4a8ed0f5a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ede0d65-1c51-4754-87e7-6d0b304b8236', 'volume_name': 'volume-7ede0d65-1c51-4754-87e7-6d0b304b8236', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c0762c-2b61-4682-a928-484f8c327e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c0762c-2b61-4682-a928-484f8c327e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (943fc9bf-6968-4a7f-9150-6d5bec2f193a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:30 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Volume 7ede0d65-1c51-4754-87e7-6d0b304b8236: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ede0d65-1c51-4754-87e7-6d0b304b8236', 'volume_size': 1} Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ef36ec1b-4bcc-4c14-8dd1-97d85a69320f tempest-VolumeDependencyTests-199317518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ef36ec1b-4bcc-4c14-8dd1-97d85a69320f tempest-VolumeDependencyTests-199317518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ef36ec1b-4bcc-4c14-8dd1-97d85a69320f tempest-VolumeDependencyTests-199317518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-ef36ec1b-4bcc-4c14-8dd1-97d85a69320f tempest-VolumeDependencyTests-199317518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ef36ec1b-4bcc-4c14-8dd1-97d85a69320f tempest-VolumeDependencyTests-199317518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ef36ec1b-4bcc-4c14-8dd1-97d85a69320f tempest-VolumeDependencyTests-199317518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:31 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:02:31 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:31 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0dfd9bf7-4d0e-493a-87d5-9c6b4003fd6a tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628.fd893d42-d83b-4794-ba4c-73af57e38dfa 1G" returned: 0 in 0.679s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0dfd9bf7-4d0e-493a-87d5-9c6b4003fd6a tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8837206-5363-4738-bc92-a509c06e6628 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628.fd893d42-d83b-4794-ba4c-73af57e38dfa {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:31 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8837206-5363-4738-bc92-a509c06e6628 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628.fd893d42-d83b-4794-ba4c-73af57e38dfa Sep 10 20:02:31 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:31 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edc33bf6-a078-48a0-9f35-cba9d5bdf63c tempest-CinderUnicodeTest-727280680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ef53227-86f0-4ecc-8626-1ca253764db4" returned: 0 in 0.368s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:31 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-edc33bf6-a078-48a0-9f35-cba9d5bdf63c tempest-CinderUnicodeTest-727280680 None] Lock "cinder-quobyte-7ef53227-86f0-4ecc-8626-1ca253764db4" released by "delete_volume" :: held 1.050s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:31 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-edc33bf6-a078-48a0-9f35-cba9d5bdf63c tempest-CinderUnicodeTest-727280680 None] Created reservations ['1a163403-8602-421d-b1a4-e6faf773eb8e', '988a3cd0-3167-46be-8bc3-5215a3a4b271', '54d0df02-270b-4a50-9457-2ac483406a14', '63aa861d-1f86-43c2-b156-9f44bcfda80a'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:02:31 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ef36ec1b-4bcc-4c14-8dd1-97d85a69320f tempest-VolumeDependencyTests-199317518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.313s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:31 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-ef36ec1b-4bcc-4c14-8dd1-97d85a69320f tempest-VolumeDependencyTests-199317518 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:02:31 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-ef36ec1b-4bcc-4c14-8dd1-97d85a69320f tempest-VolumeDependencyTests-199317518 None] Deleted volume successfully. Sep 10 20:02:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-edc33bf6-a078-48a0-9f35-cba9d5bdf63c tempest-CinderUnicodeTest-727280680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-edc33bf6-a078-48a0-9f35-cba9d5bdf63c tempest-CinderUnicodeTest-727280680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-edc33bf6-a078-48a0-9f35-cba9d5bdf63c tempest-CinderUnicodeTest-727280680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-edc33bf6-a078-48a0-9f35-cba9d5bdf63c tempest-CinderUnicodeTest-727280680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-edc33bf6-a078-48a0-9f35-cba9d5bdf63c tempest-CinderUnicodeTest-727280680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edc33bf6-a078-48a0-9f35-cba9d5bdf63c tempest-CinderUnicodeTest-727280680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:31 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-ef36ec1b-4bcc-4c14-8dd1-97d85a69320f tempest-VolumeDependencyTests-199317518 None] Lock "cinder-7327e40d-666f-4487-b96b-022355e9042a-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:31 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:02:31 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:31 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0dfd9bf7-4d0e-493a-87d5-9c6b4003fd6a tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8837206-5363-4738-bc92-a509c06e6628 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628.fd893d42-d83b-4794-ba4c-73af57e38dfa" returned: 0 in 0.364s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:31 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-0dfd9bf7-4d0e-493a-87d5-9c6b4003fd6a tempest-CreateVolumesFromSnapshotTest-438369082 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628.fd893d42-d83b-4794-ba4c-73af57e38dfa is being set with open permissions: ugo+rw Sep 10 20:02:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0dfd9bf7-4d0e-493a-87d5-9c6b4003fd6a tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628.fd893d42-d83b-4794-ba4c-73af57e38dfa {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:31 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628.fd893d42-d83b-4794-ba4c-73af57e38dfa Sep 10 20:02:31 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:31 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-edc33bf6-a078-48a0-9f35-cba9d5bdf63c tempest-CinderUnicodeTest-727280680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.337s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:31 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-edc33bf6-a078-48a0-9f35-cba9d5bdf63c tempest-CinderUnicodeTest-727280680 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:02:31 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:31 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-edc33bf6-a078-48a0-9f35-cba9d5bdf63c tempest-CinderUnicodeTest-727280680 None] Deleted volume successfully. Sep 10 20:02:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0dfd9bf7-4d0e-493a-87d5-9c6b4003fd6a tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628.fd893d42-d83b-4794-ba4c-73af57e38dfa" returned: 0 in 0.267s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:31 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-edc33bf6-a078-48a0-9f35-cba9d5bdf63c tempest-CinderUnicodeTest-727280680 None] Lock "cinder-7ef53227-86f0-4ecc-8626-1ca253764db4-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0dfd9bf7-4d0e-493a-87d5-9c6b4003fd6a tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:31 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628.info Sep 10 20:02:31 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:31 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0dfd9bf7-4d0e-493a-87d5-9c6b4003fd6a tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628.info" returned: 0 in 0.259s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:31 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-0dfd9bf7-4d0e-493a-87d5-9c6b4003fd6a tempest-CreateVolumesFromSnapshotTest-438369082 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628.info is being set with open permissions: ugo+rw Sep 10 20:02:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0dfd9bf7-4d0e-493a-87d5-9c6b4003fd6a tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:32 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628.info Sep 10 20:02:32 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:32 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0dfd9bf7-4d0e-493a-87d5-9c6b4003fd6a tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628.info" returned: 0 in 0.258s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0dfd9bf7-4d0e-493a-87d5-9c6b4003fd6a tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.451s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.366s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:32 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-612044566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ede0d65-1c51-4754-87e7-6d0b304b8236,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54800cb281b41beb2b8c191b807e7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:31Z,use_quota=True,user_id='45f4efe5ac094bbdb01d6e0f4357edfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:02:32 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Creating volume 7ede0d65-1c51-4754-87e7-6d0b304b8236 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:02:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:32 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:32 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:32 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:02:32 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:02:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ede0d65-1c51-4754-87e7-6d0b304b8236 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:32 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9748a569-0dd0-4e02-8b93-85afdff92507 tempest-CinderUnicodeTest-727280680 None] Acquiring lock "cinder-7658d3dc-8c25-4808-a8f4-53c6bcc5acb8-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:32 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ede0d65-1c51-4754-87e7-6d0b304b8236 1073741824 Sep 10 20:02:32 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:32 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9748a569-0dd0-4e02-8b93-85afdff92507 tempest-CinderUnicodeTest-727280680 None] Lock "cinder-7658d3dc-8c25-4808-a8f4-53c6bcc5acb8-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:32 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-0dfd9bf7-4d0e-493a-87d5-9c6b4003fd6a tempest-CreateVolumesFromSnapshotTest-438369082 None] Create snapshot completed successfully Sep 10 20:02:32 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9748a569-0dd0-4e02-8b93-85afdff92507 tempest-CinderUnicodeTest-727280680 None] Acquiring lock "cinder-quobyte-7658d3dc-8c25-4808-a8f4-53c6bcc5acb8" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:32 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9748a569-0dd0-4e02-8b93-85afdff92507 tempest-CinderUnicodeTest-727280680 None] Lock "cinder-quobyte-7658d3dc-8c25-4808-a8f4-53c6bcc5acb8" acquired by "delete_volume" :: waited 0.017s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:32 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[2927df64-c817-4b28-ab66-ca6940701ef1]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9748a569-0dd0-4e02-8b93-85afdff92507 tempest-CinderUnicodeTest-727280680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7658d3dc-8c25-4808-a8f4-53c6bcc5acb8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:32 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7658d3dc-8c25-4808-a8f4-53c6bcc5acb8 Sep 10 20:02:32 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:32 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ede0d65-1c51-4754-87e7-6d0b304b8236 1073741824" returned: 0 in 0.618s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:32 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9748a569-0dd0-4e02-8b93-85afdff92507 tempest-CinderUnicodeTest-727280680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7658d3dc-8c25-4808-a8f4-53c6bcc5acb8" returned: 0 in 0.508s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9748a569-0dd0-4e02-8b93-85afdff92507 tempest-CinderUnicodeTest-727280680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7658d3dc-8c25-4808-a8f4-53c6bcc5acb8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ede0d65-1c51-4754-87e7-6d0b304b8236 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:32 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7658d3dc-8c25-4808-a8f4-53c6bcc5acb8 Sep 10 20:02:32 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:33 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ede0d65-1c51-4754-87e7-6d0b304b8236 Sep 10 20:02:33 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:33 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ede0d65-1c51-4754-87e7-6d0b304b8236" returned: 0 in 0.333s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:33 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9748a569-0dd0-4e02-8b93-85afdff92507 tempest-CinderUnicodeTest-727280680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7658d3dc-8c25-4808-a8f4-53c6bcc5acb8" returned: 0 in 0.379s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (943fc9bf-6968-4a7f-9150-6d5bec2f193a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ede0d65-1c51-4754-87e7-6d0b304b8236', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0057d7a9-eefe-432f-b33f-2cc72e341820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9748a569-0dd0-4e02-8b93-85afdff92507 tempest-CinderUnicodeTest-727280680 None] Lock "cinder-quobyte-7658d3dc-8c25-4808-a8f4-53c6bcc5acb8" released by "delete_volume" :: held 0.943s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:33 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Volume volume-7ede0d65-1c51-4754-87e7-6d0b304b8236 (7ede0d65-1c51-4754-87e7-6d0b304b8236): created successfully Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0057d7a9-eefe-432f-b33f-2cc72e341820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Flow 'volume_create_manager' (09c65c35-f2d9-40e0-81cc-324d8ee7ad1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:33 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-a4c40243-d504-4ca2-b2b9-211c25e7c2c7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Created volume successfully. Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-9748a569-0dd0-4e02-8b93-85afdff92507 tempest-CinderUnicodeTest-727280680 None] Created reservations ['138e7bc9-a64b-4861-90a3-866fa20359ae', 'eca4fff3-949a-4c83-a25c-9c33748d21df', 'c38bca92-4b02-4879-91ca-57f029dccf03', '3bc1c23b-915c-4ec2-99e6-05a11fe9eb79'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9748a569-0dd0-4e02-8b93-85afdff92507 tempest-CinderUnicodeTest-727280680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9748a569-0dd0-4e02-8b93-85afdff92507 tempest-CinderUnicodeTest-727280680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9748a569-0dd0-4e02-8b93-85afdff92507 tempest-CinderUnicodeTest-727280680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9748a569-0dd0-4e02-8b93-85afdff92507 tempest-CinderUnicodeTest-727280680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9748a569-0dd0-4e02-8b93-85afdff92507 tempest-CinderUnicodeTest-727280680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9748a569-0dd0-4e02-8b93-85afdff92507 tempest-CinderUnicodeTest-727280680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:33 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:02:33 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] Flow 'volume_create_manager' (5dc6cde0-a3f1-4ff0-aa92-1a7e62c06b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b09167d-3ff8-4ad3-bfa0-18fbd3528f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b09167d-3ff8-4ad3-bfa0-18fbd3528f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-849202781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f1ada98-7c18-4c17-8fc1-14460a95e85a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283266e15b4e4b05bbb0c16e501bc1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:34Z,use_quota=True,user_id='e2b078fd715344f3aa756755f0038edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5bfe0be-3626-4a2d-86e1-ed9bf9a8105b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5bfe0be-3626-4a2d-86e1-ed9bf9a8105b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (710a6bbd-ea9c-49b4-9982-f105e9e0644c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (710a6bbd-ea9c-49b4-9982-f105e9e0644c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f1ada98-7c18-4c17-8fc1-14460a95e85a', 'volume_name': 'volume-5f1ada98-7c18-4c17-8fc1-14460a95e85a', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d38b5e36-f6ce-4186-99fa-9451f35d2f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d38b5e36-f6ce-4186-99fa-9451f35d2f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a2fbee-56ea-42dd-b2db-61171afcee60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:33 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] Volume 5f1ada98-7c18-4c17-8fc1-14460a95e85a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f1ada98-7c18-4c17-8fc1-14460a95e85a', 'volume_size': 1} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-849202781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f1ada98-7c18-4c17-8fc1-14460a95e85a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283266e15b4e4b05bbb0c16e501bc1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:34Z,use_quota=True,user_id='e2b078fd715344f3aa756755f0038edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] Creating volume 5f1ada98-7c18-4c17-8fc1-14460a95e85a {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:02:33 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5f1ada98-7c18-4c17-8fc1-14460a95e85a 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:33 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5f1ada98-7c18-4c17-8fc1-14460a95e85a 1073741824 Sep 10 20:02:33 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:33 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9748a569-0dd0-4e02-8b93-85afdff92507 tempest-CinderUnicodeTest-727280680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.423s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:33 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-9748a569-0dd0-4e02-8b93-85afdff92507 tempest-CinderUnicodeTest-727280680 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:02:33 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-9748a569-0dd0-4e02-8b93-85afdff92507 tempest-CinderUnicodeTest-727280680 None] Deleted volume successfully. Sep 10 20:02:34 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9748a569-0dd0-4e02-8b93-85afdff92507 tempest-CinderUnicodeTest-727280680 None] Lock "cinder-7658d3dc-8c25-4808-a8f4-53c6bcc5acb8-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:34 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:02:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] Flow 'volume_create_manager' (8e61ed2f-60ed-44b5-90d7-613653a82c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab5958f8-7473-4f7e-a9cd-5f358d84c55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab5958f8-7473-4f7e-a9cd-5f358d84c55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1755284949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd2d504-4386-45ae-afbf-40e59c150168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283266e15b4e4b05bbb0c16e501bc1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:34Z,use_quota=True,user_id='e2b078fd715344f3aa756755f0038edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94c7da55-c36f-4ad2-9b5d-4945d1f982da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94c7da55-c36f-4ad2-9b5d-4945d1f982da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cc5e455-86f5-4ea3-8377-e4b2e46e5289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cc5e455-86f5-4ea3-8377-e4b2e46e5289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bd2d504-4386-45ae-afbf-40e59c150168', 'volume_name': 'volume-4bd2d504-4386-45ae-afbf-40e59c150168', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad22655-dac4-4714-8bb1-c78e39035635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad22655-dac4-4714-8bb1-c78e39035635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef1756c4-c441-409f-9d9b-1b5588016d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:34 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] Volume 4bd2d504-4386-45ae-afbf-40e59c150168: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bd2d504-4386-45ae-afbf-40e59c150168', 'volume_size': 1} Sep 10 20:02:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:34 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5f1ada98-7c18-4c17-8fc1-14460a95e85a 1073741824" returned: 0 in 0.824s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5f1ada98-7c18-4c17-8fc1-14460a95e85a {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:34 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5f1ada98-7c18-4c17-8fc1-14460a95e85a Sep 10 20:02:34 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Flow 'volume_create_manager' (b52d371c-f531-49e8-a42f-c6036013490b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec1bf98-7ff0-4614-8824-f6a90b517808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec1bf98-7ff0-4614-8824-f6a90b517808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-362153324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bb0daf2-3a72-4c08-976f-38484a7bca07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54800cb281b41beb2b8c191b807e7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:35Z,use_quota=True,user_id='45f4efe5ac094bbdb01d6e0f4357edfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84cff54e-9118-4b02-a5a9-66cfda84e2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84cff54e-9118-4b02-a5a9-66cfda84e2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (372c8616-6ec0-4a16-9b57-a5b8eb6eaf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (372c8616-6ec0-4a16-9b57-a5b8eb6eaf19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bb0daf2-3a72-4c08-976f-38484a7bca07', 'volume_name': 'volume-1bb0daf2-3a72-4c08-976f-38484a7bca07', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23cb69d9-8533-4fd5-a709-aa69b1174122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23cb69d9-8533-4fd5-a709-aa69b1174122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23dca2b2-3bcd-4f84-9900-cc031f082bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:35 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Volume 1bb0daf2-3a72-4c08-976f-38484a7bca07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bb0daf2-3a72-4c08-976f-38484a7bca07', 'volume_size': 1} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:35 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5f1ada98-7c18-4c17-8fc1-14460a95e85a" returned: 0 in 0.470s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.547s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1755284949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd2d504-4386-45ae-afbf-40e59c150168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283266e15b4e4b05bbb0c16e501bc1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:34Z,use_quota=True,user_id='e2b078fd715344f3aa756755f0038edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] Creating volume 4bd2d504-4386-45ae-afbf-40e59c150168 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:02:35 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4bd2d504-4386-45ae-afbf-40e59c150168 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:35 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4bd2d504-4386-45ae-afbf-40e59c150168 1073741824 Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a2fbee-56ea-42dd-b2db-61171afcee60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f1ada98-7c18-4c17-8fc1-14460a95e85a', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:35 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e164e53-fc67-4853-8ce9-cf79048879f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] Flow 'volume_create_manager' (3547b555-b2b3-4acc-b868-833403dd37a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee16f25-135f-405e-81d7-1562f1069e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:35 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] Volume volume-5f1ada98-7c18-4c17-8fc1-14460a95e85a (5f1ada98-7c18-4c17-8fc1-14460a95e85a): created successfully Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e164e53-fc67-4853-8ce9-cf79048879f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] Flow 'volume_create_manager' (5dc6cde0-a3f1-4ff0-aa92-1a7e62c06b06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee16f25-135f-405e-81d7-1562f1069e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-222330088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baf69e90-7445-4d86-b465-d6f861d366f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283266e15b4e4b05bbb0c16e501bc1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:35Z,use_quota=True,user_id='e2b078fd715344f3aa756755f0038edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ee1540-2a30-4f33-aaaa-a7e605bd0b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ee1540-2a30-4f33-aaaa-a7e605bd0b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3834810-7d69-43ad-ba98-3c307ed973c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3834810-7d69-43ad-ba98-3c307ed973c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baf69e90-7445-4d86-b465-d6f861d366f2', 'volume_name': 'volume-baf69e90-7445-4d86-b465-d6f861d366f2', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad2a241-433c-46c9-9612-6051d0aa6926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad2a241-433c-46c9-9612-6051d0aa6926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7944a077-5195-4059-9f35-f8b43aa6294c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:35 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] Volume baf69e90-7445-4d86-b465-d6f861d366f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baf69e90-7445-4d86-b465-d6f861d366f2', 'volume_size': 1} Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:35 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-1e75e82b-27c3-42d8-beb3-793e965df08d tempest-CreateVolumesFromSnapshotTest-438369082 None] Created volume successfully. Sep 10 20:02:35 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:02:36 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Flow 'volume_create_manager' (06120693-b5c2-48d7-874b-f49572164566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:36 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cea122a9-4819-497c-9a63-0eee8e25b601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:36 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cea122a9-4819-497c-9a63-0eee8e25b601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-219637896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=803ca3bd-473d-46fd-8ca6-426440888d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54800cb281b41beb2b8c191b807e7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:36Z,use_quota=True,user_id='45f4efe5ac094bbdb01d6e0f4357edfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:36 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be130c1c-fdbf-4a0f-bd29-8af97731e342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:36 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be130c1c-fdbf-4a0f-bd29-8af97731e342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:36 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41dc6824-d6ca-4752-9c50-8bc61eeb39d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:36 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41dc6824-d6ca-4752-9c50-8bc61eeb39d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '803ca3bd-473d-46fd-8ca6-426440888d3b', 'volume_name': 'volume-803ca3bd-473d-46fd-8ca6-426440888d3b', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:36 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:36 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91af08a-3684-4049-8de8-9f94aa81dde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:36 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91af08a-3684-4049-8de8-9f94aa81dde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:36 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78fb1fed-ad1f-41b5-8160-6d4b88c82d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:36 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Volume 803ca3bd-473d-46fd-8ca6-426440888d3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-803ca3bd-473d-46fd-8ca6-426440888d3b', 'volume_size': 1} Sep 10 20:02:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4bd2d504-4386-45ae-afbf-40e59c150168 1073741824" returned: 0 in 1.035s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4bd2d504-4386-45ae-afbf-40e59c150168 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:36 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4bd2d504-4386-45ae-afbf-40e59c150168 Sep 10 20:02:36 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:36 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4bd2d504-4386-45ae-afbf-40e59c150168" returned: 0 in 0.535s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:36 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:02:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.723s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:36 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-362153324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bb0daf2-3a72-4c08-976f-38484a7bca07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54800cb281b41beb2b8c191b807e7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:35Z,use_quota=True,user_id='45f4efe5ac094bbdb01d6e0f4357edfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:02:36 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Creating volume 1bb0daf2-3a72-4c08-976f-38484a7bca07 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:02:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:36 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:36 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:36 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:02:36 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:02:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1bb0daf2-3a72-4c08-976f-38484a7bca07 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:37 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1bb0daf2-3a72-4c08-976f-38484a7bca07 1073741824 Sep 10 20:02:37 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef1756c4-c441-409f-9d9b-1b5588016d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bd2d504-4386-45ae-afbf-40e59c150168', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e654c5f0-4b25-4c47-a911-2ae112f1104b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:37 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] Volume volume-4bd2d504-4386-45ae-afbf-40e59c150168 (4bd2d504-4386-45ae-afbf-40e59c150168): created successfully Sep 10 20:02:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e654c5f0-4b25-4c47-a911-2ae112f1104b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] Flow 'volume_create_manager' (8e61ed2f-60ed-44b5-90d7-613653a82c2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:37 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:02:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Flow 'volume_create_manager' (6c4003e2-4fe6-4ce8-b4f5-0ef58702b1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c7dbedd-180f-4b8e-82bd-5811f36021fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:37 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-0d7ffd27-9bdc-4a06-8b23-f129f5465bec tempest-CreateVolumesFromSnapshotTest-438369082 None] Created volume successfully. Sep 10 20:02:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c7dbedd-180f-4b8e-82bd-5811f36021fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-979318976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba053ed-024f-4877-9704-49f406085084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283266e15b4e4b05bbb0c16e501bc1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:37Z,use_quota=True,user_id='e2b078fd715344f3aa756755f0038edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5077a0b2-dec3-4e8e-9f27-58ad2a7d2169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5077a0b2-dec3-4e8e-9f27-58ad2a7d2169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b2ee0e7-42d1-40df-b43a-6046e9602d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b2ee0e7-42d1-40df-b43a-6046e9602d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bba053ed-024f-4877-9704-49f406085084', 'volume_name': 'volume-bba053ed-024f-4877-9704-49f406085084', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74b84e6e-fb24-46cd-ba98-825383985fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74b84e6e-fb24-46cd-ba98-825383985fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee1d58b6-f6ed-4bf7-a44b-cebca25646bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:37 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Volume bba053ed-024f-4877-9704-49f406085084: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bba053ed-024f-4877-9704-49f406085084', 'volume_size': 1} Sep 10 20:02:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:37 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:02:37 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Flow 'volume_create_manager' (633b5cb5-6318-4ff1-a038-2567cc861923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa44968a-2446-47c4-9c8a-5206e0d15821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:37 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:02:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] Flow 'volume_create_manager' (1d2ceb8d-4cda-4959-8856-a8cc5cf6f568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cf42f4a-70d4-4f05-afee-62591aaabe88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1bb0daf2-3a72-4c08-976f-38484a7bca07 1073741824" returned: 0 in 1.037s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa44968a-2446-47c4-9c8a-5206e0d15821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-765268495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b51d71c-ad81-4fd1-a226-141679431af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54800cb281b41beb2b8c191b807e7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:38Z,use_quota=True,user_id='45f4efe5ac094bbdb01d6e0f4357edfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49f06445-dd69-4b26-a7c6-1403c98267f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49f06445-dd69-4b26-a7c6-1403c98267f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddba128c-6074-437c-a2fe-26a64cde88a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddba128c-6074-437c-a2fe-26a64cde88a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b51d71c-ad81-4fd1-a226-141679431af0', 'volume_name': 'volume-2b51d71c-ad81-4fd1-a226-141679431af0', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75fa0b89-872c-4c54-a06b-230f3507e3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75fa0b89-872c-4c54-a06b-230f3507e3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f40dc9-ed78-436d-925c-2c8cec8e9263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:38 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Volume 2b51d71c-ad81-4fd1-a226-141679431af0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b51d71c-ad81-4fd1-a226-141679431af0', 'volume_size': 1} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Flow 'volume_create_manager' (815690d6-216f-4d59-8774-37f25db3c236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657d2d54-697d-4f92-960b-fe169b2829c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cf42f4a-70d4-4f05-afee-62591aaabe88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-817710464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c1fe112-3b63-40a2-a257-27b9f28f4942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283266e15b4e4b05bbb0c16e501bc1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:38Z,use_quota=True,user_id='e2b078fd715344f3aa756755f0038edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e7aadd-89f1-4652-8629-6d1e14b781bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e7aadd-89f1-4652-8629-6d1e14b781bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23f759ac-b754-46ee-8052-02ac17d2e119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23f759ac-b754-46ee-8052-02ac17d2e119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c1fe112-3b63-40a2-a257-27b9f28f4942', 'volume_name': 'volume-4c1fe112-3b63-40a2-a257-27b9f28f4942', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf5e4534-0156-4027-a34b-fd299abec223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf5e4534-0156-4027-a34b-fd299abec223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a08ad775-7ee1-4a99-9ba7-9657060d8648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:38 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] Volume 4c1fe112-3b63-40a2-a257-27b9f28f4942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c1fe112-3b63-40a2-a257-27b9f28f4942', 'volume_size': 1} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657d2d54-697d-4f92-960b-fe169b2829c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1747936663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ef43e85-c186-4d52-bb88-bec34e81d1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54800cb281b41beb2b8c191b807e7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:38Z,use_quota=True,user_id='45f4efe5ac094bbdb01d6e0f4357edfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a6bd58-5936-44b3-b0d6-d5fa2c45a20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a6bd58-5936-44b3-b0d6-d5fa2c45a20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f547825-4b77-4621-a350-547e1fab3f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f547825-4b77-4621-a350-547e1fab3f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ef43e85-c186-4d52-bb88-bec34e81d1b2', 'volume_name': 'volume-3ef43e85-c186-4d52-bb88-bec34e81d1b2', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f76559-fd63-4a52-8947-b34f67c6ff84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f76559-fd63-4a52-8947-b34f67c6ff84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce150dcc-8c60-46e4-9d73-ccd23523b237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:38 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Volume 3ef43e85-c186-4d52-bb88-bec34e81d1b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ef43e85-c186-4d52-bb88-bec34e81d1b2', 'volume_size': 1} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Flow 'volume_create_manager' (77ac4243-0bcc-4f57-8a9a-971c1f35f87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4143e560-000a-4206-9249-a466768c83e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4143e560-000a-4206-9249-a466768c83e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-241182180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ed7adf-907d-4137-b6fa-988da9869153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54800cb281b41beb2b8c191b807e7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:38Z,use_quota=True,user_id='45f4efe5ac094bbdb01d6e0f4357edfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a02d4651-ad1a-48c4-be4d-c938ca52518a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a02d4651-ad1a-48c4-be4d-c938ca52518a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c1a6f87-a313-4645-8ecb-edde49a054bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c1a6f87-a313-4645-8ecb-edde49a054bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6ed7adf-907d-4137-b6fa-988da9869153', 'volume_name': 'volume-f6ed7adf-907d-4137-b6fa-988da9869153', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (929b0591-0ae2-455c-9d67-12d2dc6a34e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (929b0591-0ae2-455c-9d67-12d2dc6a34e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2017257-ed24-42a5-9cb6-c3e033b8d817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:38 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Volume f6ed7adf-907d-4137-b6fa-988da9869153: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6ed7adf-907d-4137-b6fa-988da9869153', 'volume_size': 1} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1bb0daf2-3a72-4c08-976f-38484a7bca07 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:38 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1bb0daf2-3a72-4c08-976f-38484a7bca07 Sep 10 20:02:38 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:38 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1bb0daf2-3a72-4c08-976f-38484a7bca07" returned: 0 in 0.290s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.198s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-222330088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baf69e90-7445-4d86-b465-d6f861d366f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283266e15b4e4b05bbb0c16e501bc1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:35Z,use_quota=True,user_id='e2b078fd715344f3aa756755f0038edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] Creating volume baf69e90-7445-4d86-b465-d6f861d366f2 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:02:38 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-baf69e90-7445-4d86-b465-d6f861d366f2 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:38 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-baf69e90-7445-4d86-b465-d6f861d366f2 1073741824 Sep 10 20:02:38 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23dca2b2-3bcd-4f84-9900-cc031f082bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bb0daf2-3a72-4c08-976f-38484a7bca07', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d70062d-d6ed-474d-a8bc-7ece9407f1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:38 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Volume volume-1bb0daf2-3a72-4c08-976f-38484a7bca07 (1bb0daf2-3a72-4c08-976f-38484a7bca07): created successfully Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d70062d-d6ed-474d-a8bc-7ece9407f1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Flow 'volume_create_manager' (b52d371c-f531-49e8-a42f-c6036013490b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:38 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-9ee15130-3ba7-4367-bfb6-7bdda8a43655 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Created volume successfully. Sep 10 20:02:39 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-baf69e90-7445-4d86-b465-d6f861d366f2 1073741824" returned: 0 in 0.534s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-baf69e90-7445-4d86-b465-d6f861d366f2 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:39 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-baf69e90-7445-4d86-b465-d6f861d366f2 Sep 10 20:02:39 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:39 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-baf69e90-7445-4d86-b465-d6f861d366f2" returned: 0 in 0.295s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:39 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:02:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.339s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:39 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-219637896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=803ca3bd-473d-46fd-8ca6-426440888d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54800cb281b41beb2b8c191b807e7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:36Z,use_quota=True,user_id='45f4efe5ac094bbdb01d6e0f4357edfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:02:39 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Creating volume 803ca3bd-473d-46fd-8ca6-426440888d3b {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:02:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:39 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:39 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:39 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:02:39 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:02:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-803ca3bd-473d-46fd-8ca6-426440888d3b 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:39 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7944a077-5195-4059-9f35-f8b43aa6294c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baf69e90-7445-4d86-b465-d6f861d366f2', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:39 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-803ca3bd-473d-46fd-8ca6-426440888d3b 1073741824 Sep 10 20:02:39 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:39 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c0e1ebb-0484-40ca-a4eb-aefebffa6f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:39 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] Volume volume-baf69e90-7445-4d86-b465-d6f861d366f2 (baf69e90-7445-4d86-b465-d6f861d366f2): created successfully Sep 10 20:02:39 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c0e1ebb-0484-40ca-a4eb-aefebffa6f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:39 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] Flow 'volume_create_manager' (3547b555-b2b3-4acc-b868-833403dd37a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:39 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-d1bd07c5-ebf4-4712-a026-59d99564b47e tempest-CreateVolumesFromSnapshotTest-438369082 None] Created volume successfully. Sep 10 20:02:40 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-803ca3bd-473d-46fd-8ca6-426440888d3b 1073741824" returned: 0 in 0.570s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-803ca3bd-473d-46fd-8ca6-426440888d3b {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:40 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-803ca3bd-473d-46fd-8ca6-426440888d3b Sep 10 20:02:40 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:40 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-803ca3bd-473d-46fd-8ca6-426440888d3b" returned: 0 in 0.308s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:02:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.112s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-979318976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba053ed-024f-4877-9704-49f406085084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283266e15b4e4b05bbb0c16e501bc1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:37Z,use_quota=True,user_id='e2b078fd715344f3aa756755f0038edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:02:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Creating volume bba053ed-024f-4877-9704-49f406085084 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:02:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:02:40 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:02:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bba053ed-024f-4877-9704-49f406085084 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:40 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bba053ed-024f-4877-9704-49f406085084 1073741824 Sep 10 20:02:40 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78fb1fed-ad1f-41b5-8160-6d4b88c82d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-803ca3bd-473d-46fd-8ca6-426440888d3b', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45771cd8-41f9-40ee-9995-50398032979f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:40 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Volume volume-803ca3bd-473d-46fd-8ca6-426440888d3b (803ca3bd-473d-46fd-8ca6-426440888d3b): created successfully Sep 10 20:02:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45771cd8-41f9-40ee-9995-50398032979f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Flow 'volume_create_manager' (06120693-b5c2-48d7-874b-f49572164566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:40 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-6b1a9065-9a84-4eee-967f-e36ba6445fc5 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Created volume successfully. Sep 10 20:02:41 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bba053ed-024f-4877-9704-49f406085084 1073741824" returned: 0 in 0.508s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bba053ed-024f-4877-9704-49f406085084 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:41 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bba053ed-024f-4877-9704-49f406085084 Sep 10 20:02:41 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:41 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:02:41 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Flow 'volume_create_manager' (f2f28014-9911-4b81-a86d-cdf65d6f27d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21694670-cd00-4bdc-bbf1-e272f8a1d5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bba053ed-024f-4877-9704-49f406085084" returned: 0 in 0.297s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:02:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.313s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-765268495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b51d71c-ad81-4fd1-a226-141679431af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54800cb281b41beb2b8c191b807e7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:38Z,use_quota=True,user_id='45f4efe5ac094bbdb01d6e0f4357edfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:02:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Creating volume 2b51d71c-ad81-4fd1-a226-141679431af0 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:02:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:02:41 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:02:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2b51d71c-ad81-4fd1-a226-141679431af0 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21694670-cd00-4bdc-bbf1-e272f8a1d5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=221142d1-6e91-4781-8614-84195c1526c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f3d44ee34b347deb83d64acc8a9d409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:41Z,use_quota=True,user_id='2774d73bb67d45278ca5e6fb60197f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (790c8ebb-f9d5-4faf-8a34-be559277f0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:41 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2b51d71c-ad81-4fd1-a226-141679431af0 1073741824 Sep 10 20:02:41 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (790c8ebb-f9d5-4faf-8a34-be559277f0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bae8ed0f-d357-4df9-bf39-6647b4ceff5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:41 devstack cinder-volume[88093]: DEBUG cinder.image.glance [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Creating Keystone auth plugin from conf {{(pid=88093) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 20:02:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee1d58b6-f6ed-4bf7-a44b-cebca25646bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bba053ed-024f-4877-9704-49f406085084', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c725e8e0-088f-4d8c-984c-9abb83dc2bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:41 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Volume volume-bba053ed-024f-4877-9704-49f406085084 (bba053ed-024f-4877-9704-49f406085084): created successfully Sep 10 20:02:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c725e8e0-088f-4d8c-984c-9abb83dc2bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Flow 'volume_create_manager' (6c4003e2-4fe6-4ce8-b4f5-0ef58702b1f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:41 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-a4b049f8-049d-42bc-afbb-8410bcdcded8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Created volume successfully. Sep 10 20:02:41 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2b51d71c-ad81-4fd1-a226-141679431af0 1073741824" returned: 0 in 0.486s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2b51d71c-ad81-4fd1-a226-141679431af0 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:42 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2b51d71c-ad81-4fd1-a226-141679431af0 Sep 10 20:02:42 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bae8ed0f-d357-4df9-bf39-6647b4ceff5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '221142d1-6e91-4781-8614-84195c1526c1', 'volume_name': 'volume-221142d1-6e91-4781-8614-84195c1526c1', 'volume_size': 1, 'image_id': '22af2b72-49b1-4c9c-8300-47374067ec7d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/22af2b72-49b1-4c9c-8300-47374067ec7d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '33e6f10d605dcf857dc8ff9a9a724925', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8f3d44ee34b347deb83d64acc8a9d409', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '79d42d994efe8d44f1989465b1cd8d5221648cdaa66fce994ec50c41bdd0124546a198bc5b27da6f5a93ed612d531bb8754da30e897bacec5e9dd8e0c35197e7', 'id': '22af2b72-49b1-4c9c-8300-47374067ec7d', 'created_at': datetime.datetime(2026, 9, 10, 18, 2, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 18, 2, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/22af2b72-49b1-4c9c-8300-47374067ec7d/file', 'properties': {}}, 'image_service': }' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40d6823-0b17-419a-ac1a-77b49e1bb50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40d6823-0b17-419a-ac1a-77b49e1bb50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d80a36b-0d32-4a11-b140-5978633af0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:42 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Volume 221142d1-6e91-4781-8614-84195c1526c1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-221142d1-6e91-4781-8614-84195c1526c1', 'volume_size': 1, 'image_id': '22af2b72-49b1-4c9c-8300-47374067ec7d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/22af2b72-49b1-4c9c-8300-47374067ec7d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '33e6f10d605dcf857dc8ff9a9a724925', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8f3d44ee34b347deb83d64acc8a9d409', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '79d42d994efe8d44f1989465b1cd8d5221648cdaa66fce994ec50c41bdd0124546a198bc5b27da6f5a93ed612d531bb8754da30e897bacec5e9dd8e0c35197e7', 'id': '22af2b72-49b1-4c9c-8300-47374067ec7d', 'created_at': datetime.datetime(2026, 9, 10, 18, 2, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 18, 2, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/22af2b72-49b1-4c9c-8300-47374067ec7d/file', 'properties': {}}, 'image_service': } Sep 10 20:02:42 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Trying to clone 221142d1-6e91-4781-8614-84195c1526c1 from image 22af2b72-49b1-4c9c-8300-47374067ec7d at location (None, [{'url': 'file:///opt/stack/data/glance/images/22af2b72-49b1-4c9c-8300-47374067ec7d', 'metadata': {}}]). {{(pid=88093) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 20:02:42 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_22af2b72-49b1-4c9c-8300-47374067ec7d_ciwdga8mdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88093) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 20:02:42 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Image download 0.00 MB at 0.00 MB/s Sep 10 20:02:42 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[982f778b-5609-49d2-ba1d-e1ed2c19d7e8]: (4, 'raw') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22af2b72-49b1-4c9c-8300-47374067ec7d_ciwdga8mdevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:42 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2b51d71c-ad81-4fd1-a226-141679431af0" returned: 0 in 0.358s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:42 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:02:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.104s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:42 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-817710464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c1fe112-3b63-40a2-a257-27b9f28f4942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283266e15b4e4b05bbb0c16e501bc1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:38Z,use_quota=True,user_id='e2b078fd715344f3aa756755f0038edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:02:42 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] Creating volume 4c1fe112-3b63-40a2-a257-27b9f28f4942 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:02:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:42 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:42 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:42 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:02:42 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:02:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4c1fe112-3b63-40a2-a257-27b9f28f4942 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:42 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4c1fe112-3b63-40a2-a257-27b9f28f4942 1073741824 Sep 10 20:02:42 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f40dc9-ed78-436d-925c-2c8cec8e9263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b51d71c-ad81-4fd1-a226-141679431af0', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f8ea7b-1a78-4129-b9e2-431733b6cc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:42 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Volume volume-2b51d71c-ad81-4fd1-a226-141679431af0 (2b51d71c-ad81-4fd1-a226-141679431af0): created successfully Sep 10 20:02:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f8ea7b-1a78-4129-b9e2-431733b6cc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Flow 'volume_create_manager' (633b5cb5-6318-4ff1-a038-2567cc861923) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:42 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-b5f123a9-880f-4b56-8343-3611844131a7 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Created volume successfully. Sep 10 20:02:42 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22af2b72-49b1-4c9c-8300-47374067ec7d_ciwdga8mdevstack@QuobyteHD Sep 10 20:02:42 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:42 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22af2b72-49b1-4c9c-8300-47374067ec7d_ciwdga8mdevstack@QuobyteHD" returned: 0 in 0.500s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22af2b72-49b1-4c9c-8300-47374067ec7d_ciwdga8mdevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:42 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22af2b72-49b1-4c9c-8300-47374067ec7d_ciwdga8mdevstack@QuobyteHD Sep 10 20:02:42 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:42 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4c1fe112-3b63-40a2-a257-27b9f28f4942 1073741824" returned: 0 in 0.574s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4c1fe112-3b63-40a2-a257-27b9f28f4942 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:43 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4c1fe112-3b63-40a2-a257-27b9f28f4942 Sep 10 20:02:43 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:43 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22af2b72-49b1-4c9c-8300-47374067ec7d_ciwdga8mdevstack@QuobyteHD" returned: 1 in 0.377s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22af2b72-49b1-4c9c-8300-47374067ec7d_ciwdga8mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Temporary image 22af2b72-49b1-4c9c-8300-47374067ec7d is fetched for user 2774d73bb67d45278ca5e6fb60197f0b. {{(pid=88093) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c675346-974d-401b-a1d7-aee0f4e9adef]: (4, 'raw') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22af2b72-49b1-4c9c-8300-47374067ec7d_ciwdga8mdevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:43 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4c1fe112-3b63-40a2-a257-27b9f28f4942" returned: 0 in 0.357s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.032s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1747936663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ef43e85-c186-4d52-bb88-bec34e81d1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54800cb281b41beb2b8c191b807e7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:38Z,use_quota=True,user_id='45f4efe5ac094bbdb01d6e0f4357edfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Creating volume 3ef43e85-c186-4d52-bb88-bec34e81d1b2 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:02:43 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3ef43e85-c186-4d52-bb88-bec34e81d1b2 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a08ad775-7ee1-4a99-9ba7-9657060d8648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c1fe112-3b63-40a2-a257-27b9f28f4942', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:43 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3ef43e85-c186-4d52-bb88-bec34e81d1b2 1073741824 Sep 10 20:02:43 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1618b7-5dd0-4537-9a48-36b900185258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:43 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22af2b72-49b1-4c9c-8300-47374067ec7d_ciwdga8mdevstack@QuobyteHD Sep 10 20:02:43 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:43 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] Volume volume-4c1fe112-3b63-40a2-a257-27b9f28f4942 (4c1fe112-3b63-40a2-a257-27b9f28f4942): created successfully Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1618b7-5dd0-4537-9a48-36b900185258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] Flow 'volume_create_manager' (1d2ceb8d-4cda-4959-8856-a8cc5cf6f568) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:43 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-492f46aa-f7a8-4463-a221-4f082d5edbcd tempest-CreateVolumesFromSnapshotTest-438369082 None] Created volume successfully. Sep 10 20:02:43 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22af2b72-49b1-4c9c-8300-47374067ec7d_ciwdga8mdevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22af2b72-49b1-4c9c-8300-47374067ec7d_ciwdga8mdevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e741fd09-2e89-48ce-a81d-6b5664868718 tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "cinder-4c1fe112-3b63-40a2-a257-27b9f28f4942-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:43 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22af2b72-49b1-4c9c-8300-47374067ec7d_ciwdga8mdevstack@QuobyteHD Sep 10 20:02:43 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e741fd09-2e89-48ce-a81d-6b5664868718 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "cinder-4c1fe112-3b63-40a2-a257-27b9f28f4942-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e741fd09-2e89-48ce-a81d-6b5664868718 tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "cinder-quobyte-4c1fe112-3b63-40a2-a257-27b9f28f4942" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e741fd09-2e89-48ce-a81d-6b5664868718 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "cinder-quobyte-4c1fe112-3b63-40a2-a257-27b9f28f4942" acquired by "delete_volume" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1512552-43f4-4840-8287-9514ea4d8ef2]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e741fd09-2e89-48ce-a81d-6b5664868718 tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4c1fe112-3b63-40a2-a257-27b9f28f4942 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:43 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3ef43e85-c186-4d52-bb88-bec34e81d1b2 1073741824" returned: 0 in 0.577s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3ef43e85-c186-4d52-bb88-bec34e81d1b2 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:44 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3ef43e85-c186-4d52-bb88-bec34e81d1b2 Sep 10 20:02:44 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:44 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4c1fe112-3b63-40a2-a257-27b9f28f4942 Sep 10 20:02:44 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:44 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22af2b72-49b1-4c9c-8300-47374067ec7d_ciwdga8mdevstack@QuobyteHD" returned: 1 in 0.444s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22af2b72-49b1-4c9c-8300-47374067ec7d_ciwdga8mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:44 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3ef43e85-c186-4d52-bb88-bec34e81d1b2" returned: 0 in 0.316s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.861s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-241182180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ed7adf-907d-4137-b6fa-988da9869153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54800cb281b41beb2b8c191b807e7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:38Z,use_quota=True,user_id='45f4efe5ac094bbdb01d6e0f4357edfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Creating volume f6ed7adf-907d-4137-b6fa-988da9869153 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:02:44 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f6ed7adf-907d-4137-b6fa-988da9869153 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce150dcc-8c60-46e4-9d73-ccd23523b237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ef43e85-c186-4d52-bb88-bec34e81d1b2', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2fa6022-87ae-488d-bb94-d8f6277262bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:44 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f6ed7adf-907d-4137-b6fa-988da9869153 1073741824 Sep 10 20:02:44 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:44 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Volume volume-3ef43e85-c186-4d52-bb88-bec34e81d1b2 (3ef43e85-c186-4d52-bb88-bec34e81d1b2): created successfully Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2fa6022-87ae-488d-bb94-d8f6277262bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Flow 'volume_create_manager' (815690d6-216f-4d59-8774-37f25db3c236) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:44 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:44 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-a56029ee-4066-4fd0-b82d-fc9d00edd424 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Created volume successfully. Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e741fd09-2e89-48ce-a81d-6b5664868718 tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4c1fe112-3b63-40a2-a257-27b9f28f4942" returned: 0 in 0.494s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e741fd09-2e89-48ce-a81d-6b5664868718 tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4c1fe112-3b63-40a2-a257-27b9f28f4942 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:44 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4c1fe112-3b63-40a2-a257-27b9f28f4942 Sep 10 20:02:44 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:44 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e741fd09-2e89-48ce-a81d-6b5664868718 tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4c1fe112-3b63-40a2-a257-27b9f28f4942" returned: 0 in 0.340s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e741fd09-2e89-48ce-a81d-6b5664868718 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "cinder-quobyte-4c1fe112-3b63-40a2-a257-27b9f28f4942" released by "delete_volume" :: held 0.885s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-e741fd09-2e89-48ce-a81d-6b5664868718 tempest-CreateVolumesFromSnapshotTest-438369082 None] Created reservations ['98ebbde3-a6f9-4356-b1db-af538d53800c', '08520310-273f-4d05-b803-8cfcbd576e4c', '05307ade-ef58-4726-9002-00546a1661c5', '8f761a49-36dc-4c7a-ac12-407c22ad118a'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:02:44 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f6ed7adf-907d-4137-b6fa-988da9869153 1073741824" returned: 0 in 0.635s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e741fd09-2e89-48ce-a81d-6b5664868718 tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e741fd09-2e89-48ce-a81d-6b5664868718 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e741fd09-2e89-48ce-a81d-6b5664868718 tempest-CreateVolumesFromSnapshotTest-438369082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e741fd09-2e89-48ce-a81d-6b5664868718 tempest-CreateVolumesFromSnapshotTest-438369082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e741fd09-2e89-48ce-a81d-6b5664868718 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e741fd09-2e89-48ce-a81d-6b5664868718 tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:45 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:02:45 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f6ed7adf-907d-4137-b6fa-988da9869153 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:45 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f6ed7adf-907d-4137-b6fa-988da9869153 Sep 10 20:02:45 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:45 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d5a40f21-c3ca-452a-88d6-c7c6e37b1cb8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "cinder-bba053ed-024f-4877-9704-49f406085084-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:45 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d5a40f21-c3ca-452a-88d6-c7c6e37b1cb8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "cinder-bba053ed-024f-4877-9704-49f406085084-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:45 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d5a40f21-c3ca-452a-88d6-c7c6e37b1cb8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "cinder-quobyte-bba053ed-024f-4877-9704-49f406085084" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:45 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d5a40f21-c3ca-452a-88d6-c7c6e37b1cb8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "cinder-quobyte-bba053ed-024f-4877-9704-49f406085084" acquired by "delete_volume" :: waited 0.027s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:45 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0025bf-2b43-467f-90c4-1356fb4cf73e]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d5a40f21-c3ca-452a-88d6-c7c6e37b1cb8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bba053ed-024f-4877-9704-49f406085084 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:45 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e741fd09-2e89-48ce-a81d-6b5664868718 tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.378s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:45 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-e741fd09-2e89-48ce-a81d-6b5664868718 tempest-CreateVolumesFromSnapshotTest-438369082 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:02:45 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-e741fd09-2e89-48ce-a81d-6b5664868718 tempest-CreateVolumesFromSnapshotTest-438369082 None] Deleted volume successfully. Sep 10 20:02:45 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f6ed7adf-907d-4137-b6fa-988da9869153" returned: 0 in 0.370s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:02:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.293s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=221142d1-6e91-4781-8614-84195c1526c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f3d44ee34b347deb83d64acc8a9d409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:02:41Z,use_quota=True,user_id='2774d73bb67d45278ca5e6fb60197f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:02:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Creating volume 221142d1-6e91-4781-8614-84195c1526c1 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:02:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:02:45 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:02:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-221142d1-6e91-4781-8614-84195c1526c1 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:45 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e741fd09-2e89-48ce-a81d-6b5664868718 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "cinder-4c1fe112-3b63-40a2-a257-27b9f28f4942-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2017257-ed24-42a5-9cb6-c3e033b8d817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6ed7adf-907d-4137-b6fa-988da9869153', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:45 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-221142d1-6e91-4781-8614-84195c1526c1 1073741824 Sep 10 20:02:45 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ee09f1-3ca7-4a0f-a024-431d0c57b956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:45 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bba053ed-024f-4877-9704-49f406085084 Sep 10 20:02:45 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:45 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Volume volume-f6ed7adf-907d-4137-b6fa-988da9869153 (f6ed7adf-907d-4137-b6fa-988da9869153): created successfully Sep 10 20:02:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ee09f1-3ca7-4a0f-a024-431d0c57b956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:45 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Flow 'volume_create_manager' (77ac4243-0bcc-4f57-8a9a-971c1f35f87a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:45 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-a8db3345-94fd-41c4-9b5f-bf24b57ff21c tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Created volume successfully. Sep 10 20:02:45 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d5a40f21-c3ca-452a-88d6-c7c6e37b1cb8 tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bba053ed-024f-4877-9704-49f406085084" returned: 0 in 0.502s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d5a40f21-c3ca-452a-88d6-c7c6e37b1cb8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bba053ed-024f-4877-9704-49f406085084 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:45 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bba053ed-024f-4877-9704-49f406085084 Sep 10 20:02:45 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:45 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-221142d1-6e91-4781-8614-84195c1526c1 1073741824" returned: 0 in 0.527s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-221142d1-6e91-4781-8614-84195c1526c1 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:46 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-221142d1-6e91-4781-8614-84195c1526c1 Sep 10 20:02:46 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:46 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d5a40f21-c3ca-452a-88d6-c7c6e37b1cb8 tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-bba053ed-024f-4877-9704-49f406085084" returned: 0 in 0.339s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:46 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c69de0bf-028c-4d74-922c-9538feebb216 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Acquiring lock "cinder-f6ed7adf-907d-4137-b6fa-988da9869153-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:46 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d5a40f21-c3ca-452a-88d6-c7c6e37b1cb8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "cinder-quobyte-bba053ed-024f-4877-9704-49f406085084" released by "delete_volume" :: held 0.943s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:46 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c69de0bf-028c-4d74-922c-9538feebb216 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "cinder-f6ed7adf-907d-4137-b6fa-988da9869153-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:46 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c69de0bf-028c-4d74-922c-9538feebb216 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Acquiring lock "cinder-quobyte-f6ed7adf-907d-4137-b6fa-988da9869153" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:46 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c69de0bf-028c-4d74-922c-9538feebb216 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "cinder-quobyte-f6ed7adf-907d-4137-b6fa-988da9869153" acquired by "delete_volume" :: waited 0.040s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:46 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-d5a40f21-c3ca-452a-88d6-c7c6e37b1cb8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Created reservations ['b03226f8-b7ea-4aab-a9de-0eb75e71e262', 'a6716b18-03ab-472e-b9ec-c97bb3d320f2', '3c5d1996-0585-4415-b7a6-85992cc9e346', 'c5e775bb-ca9b-4835-8e91-c16a324ff033'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:02:46 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7c36f6-6aee-46c4-a5b6-2b3bae1535db]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c69de0bf-028c-4d74-922c-9538feebb216 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f6ed7adf-907d-4137-b6fa-988da9869153 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:46 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-221142d1-6e91-4781-8614-84195c1526c1" returned: 0 in 0.392s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:46 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:02:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:46 devstack cinder-volume[88093]: DEBUG cinder.volume.volume_utils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Attempting download of 22af2b72-49b1-4c9c-8300-47374067ec7d ((None, [{'url': 'file:///opt/stack/data/glance/images/22af2b72-49b1-4c9c-8300-47374067ec7d', 'metadata': {}}])) to volume 221142d1-6e91-4781-8614-84195c1526c1. {{(pid=88093) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 20:02:46 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f6ed7adf-907d-4137-b6fa-988da9869153 Sep 10 20:02:46 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d5a40f21-c3ca-452a-88d6-c7c6e37b1cb8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d5a40f21-c3ca-452a-88d6-c7c6e37b1cb8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:46 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d5a40f21-c3ca-452a-88d6-c7c6e37b1cb8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:46 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-d5a40f21-c3ca-452a-88d6-c7c6e37b1cb8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-d5a40f21-c3ca-452a-88d6-c7c6e37b1cb8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d5a40f21-c3ca-452a-88d6-c7c6e37b1cb8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:46 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[06454d8a-4121-4f8b-be70-284c6530840f]: (4, 'raw') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_22af2b72-49b1-4c9c-8300-47374067ec7d_8qm745fv {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:46 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:02:46 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:46 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_22af2b72-49b1-4c9c-8300-47374067ec7d_8qm745fv Sep 10 20:02:46 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:46 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d5a40f21-c3ca-452a-88d6-c7c6e37b1cb8 tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.269s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:46 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:46 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-d5a40f21-c3ca-452a-88d6-c7c6e37b1cb8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:02:46 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-d5a40f21-c3ca-452a-88d6-c7c6e37b1cb8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Deleted volume successfully. Sep 10 20:02:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c69de0bf-028c-4d74-922c-9538feebb216 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f6ed7adf-907d-4137-b6fa-988da9869153" returned: 0 in 0.470s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c69de0bf-028c-4d74-922c-9538feebb216 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f6ed7adf-907d-4137-b6fa-988da9869153 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:46 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d5a40f21-c3ca-452a-88d6-c7c6e37b1cb8 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "cinder-bba053ed-024f-4877-9704-49f406085084-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:46 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f6ed7adf-907d-4137-b6fa-988da9869153 Sep 10 20:02:46 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:47 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_22af2b72-49b1-4c9c-8300-47374067ec7d_8qm745fv" returned: 0 in 0.474s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22af2b72-49b1-4c9c-8300-47374067ec7d_8qm745fv {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:47 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c69de0bf-028c-4d74-922c-9538feebb216 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-f6ed7adf-907d-4137-b6fa-988da9869153" returned: 0 in 0.311s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:47 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c69de0bf-028c-4d74-922c-9538feebb216 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "cinder-quobyte-f6ed7adf-907d-4137-b6fa-988da9869153" released by "delete_volume" :: held 0.845s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:47 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22af2b72-49b1-4c9c-8300-47374067ec7d_8qm745fv Sep 10 20:02:47 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:47 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-c69de0bf-028c-4d74-922c-9538feebb216 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Created reservations ['f111a8b6-40d0-40b4-b135-f91f8a368915', 'd766740e-57bd-4bee-9383-975ba5e4bb46', 'd3198c83-88f7-4dd4-871f-8b5bd6556b46', 'bff2f1bc-5db9-4acb-bdb4-d6bd0cabbc14'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:02:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c69de0bf-028c-4d74-922c-9538feebb216 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c69de0bf-028c-4d74-922c-9538feebb216 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:47 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c69de0bf-028c-4d74-922c-9538feebb216 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:47 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c69de0bf-028c-4d74-922c-9538feebb216 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c69de0bf-028c-4d74-922c-9538feebb216 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c69de0bf-028c-4d74-922c-9538feebb216 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:47 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:02:47 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:47 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-29f46c00-12a4-4c56-b800-4e7171a6ca94 tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "cinder-baf69e90-7445-4d86-b465-d6f861d366f2-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:47 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b1475145-6f33-41e3-8872-f43479309606 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Acquiring lock "cinder-3ef43e85-c186-4d52-bb88-bec34e81d1b2-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:47 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b1475145-6f33-41e3-8872-f43479309606 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "cinder-3ef43e85-c186-4d52-bb88-bec34e81d1b2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:47 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-29f46c00-12a4-4c56-b800-4e7171a6ca94 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "cinder-baf69e90-7445-4d86-b465-d6f861d366f2-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:47 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22af2b72-49b1-4c9c-8300-47374067ec7d_8qm745fv" returned: 1 in 0.559s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22af2b72-49b1-4c9c-8300-47374067ec7d_8qm745fv' failed. Not Retrying. {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:02:47 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecc9680-8466-4b14-8233-91af7d5c5d8a]: (4, 'raw') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22af2b72-49b1-4c9c-8300-47374067ec7d_ciwdga8mdevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:47 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b1475145-6f33-41e3-8872-f43479309606 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Acquiring lock "cinder-quobyte-3ef43e85-c186-4d52-bb88-bec34e81d1b2" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:47 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-29f46c00-12a4-4c56-b800-4e7171a6ca94 tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "cinder-quobyte-baf69e90-7445-4d86-b465-d6f861d366f2" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:47 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b1475145-6f33-41e3-8872-f43479309606 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "cinder-quobyte-3ef43e85-c186-4d52-bb88-bec34e81d1b2" acquired by "delete_volume" :: waited 0.042s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:47 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-29f46c00-12a4-4c56-b800-4e7171a6ca94 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "cinder-quobyte-baf69e90-7445-4d86-b465-d6f861d366f2" acquired by "delete_volume" :: waited 0.045s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:47 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa06ad8-6d2b-44ba-9b93-402f553a3b5c]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b1475145-6f33-41e3-8872-f43479309606 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3ef43e85-c186-4d52-bb88-bec34e81d1b2 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:47 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8fe2fc-a7dc-4d2d-865a-ff7b40c6e3d2]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-29f46c00-12a4-4c56-b800-4e7171a6ca94 tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-baf69e90-7445-4d86-b465-d6f861d366f2 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:47 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22af2b72-49b1-4c9c-8300-47374067ec7d_ciwdga8mdevstack@QuobyteHD Sep 10 20:02:47 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:47 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c69de0bf-028c-4d74-922c-9538feebb216 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.438s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:47 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-c69de0bf-028c-4d74-922c-9538feebb216 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:02:47 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-c69de0bf-028c-4d74-922c-9538feebb216 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Deleted volume successfully. Sep 10 20:02:47 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c69de0bf-028c-4d74-922c-9538feebb216 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "cinder-f6ed7adf-907d-4137-b6fa-988da9869153-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:47 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3ef43e85-c186-4d52-bb88-bec34e81d1b2 Sep 10 20:02:47 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:47 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-baf69e90-7445-4d86-b465-d6f861d366f2 Sep 10 20:02:47 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:48 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22af2b72-49b1-4c9c-8300-47374067ec7d_ciwdga8mdevstack@QuobyteHD" returned: 0 in 0.424s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22af2b72-49b1-4c9c-8300-47374067ec7d_ciwdga8mdevstack@QuobyteHD {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:48 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22af2b72-49b1-4c9c-8300-47374067ec7d_ciwdga8mdevstack@QuobyteHD Sep 10 20:02:48 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:48 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:48 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b1475145-6f33-41e3-8872-f43479309606 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3ef43e85-c186-4d52-bb88-bec34e81d1b2" returned: 0 in 0.554s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b1475145-6f33-41e3-8872-f43479309606 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3ef43e85-c186-4d52-bb88-bec34e81d1b2 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-29f46c00-12a4-4c56-b800-4e7171a6ca94 tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-baf69e90-7445-4d86-b465-d6f861d366f2" returned: 0 in 0.545s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-29f46c00-12a4-4c56-b800-4e7171a6ca94 tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-baf69e90-7445-4d86-b465-d6f861d366f2 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:48 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3ef43e85-c186-4d52-bb88-bec34e81d1b2 Sep 10 20:02:48 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:48 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-baf69e90-7445-4d86-b465-d6f861d366f2 Sep 10 20:02:48 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:48 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22af2b72-49b1-4c9c-8300-47374067ec7d_ciwdga8mdevstack@QuobyteHD" returned: 1 in 0.457s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22af2b72-49b1-4c9c-8300-47374067ec7d_ciwdga8mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:02:48 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] 22af2b72-49b1-4c9c-8300-47374067ec7d was raw, converting to qcow2 {{(pid=88093) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 20:02:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_22af2b72-49b1-4c9c-8300-47374067ec7d_ciwdga8mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-221142d1-6e91-4781-8614-84195c1526c1 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:48 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_22af2b72-49b1-4c9c-8300-47374067ec7d_ciwdga8mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-221142d1-6e91-4781-8614-84195c1526c1 Sep 10 20:02:48 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:48 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b1475145-6f33-41e3-8872-f43479309606 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3ef43e85-c186-4d52-bb88-bec34e81d1b2" returned: 0 in 0.286s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:48 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b1475145-6f33-41e3-8872-f43479309606 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "cinder-quobyte-3ef43e85-c186-4d52-bb88-bec34e81d1b2" released by "delete_volume" :: held 0.911s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:48 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-29f46c00-12a4-4c56-b800-4e7171a6ca94 tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-baf69e90-7445-4d86-b465-d6f861d366f2" returned: 0 in 0.366s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:48 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-29f46c00-12a4-4c56-b800-4e7171a6ca94 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "cinder-quobyte-baf69e90-7445-4d86-b465-d6f861d366f2" released by "delete_volume" :: held 0.988s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:48 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-b1475145-6f33-41e3-8872-f43479309606 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Created reservations ['f451fb71-2c6e-4077-a331-9f898dc32080', 'adfd9044-ed06-4166-9988-d790790e6e18', 'db01019b-7f9e-4243-a60d-7431e13a6af2', '658791ec-70a2-4f60-86a4-fb7338b658fa'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:02:48 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-29f46c00-12a4-4c56-b800-4e7171a6ca94 tempest-CreateVolumesFromSnapshotTest-438369082 None] Created reservations ['1aefe4c4-3ab2-4de9-91ee-4578a450aeed', '9a57b172-602f-4c1d-9800-d1a61c7f8ca7', '1a55d03b-e8e0-4a18-a72b-4a057a3299f9', '3da1a00b-b472-4c8c-bd73-1dc2a02cb480'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:02:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b1475145-6f33-41e3-8872-f43479309606 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b1475145-6f33-41e3-8872-f43479309606 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:48 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b1475145-6f33-41e3-8872-f43479309606 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:48 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b1475145-6f33-41e3-8872-f43479309606 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b1475145-6f33-41e3-8872-f43479309606 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b1475145-6f33-41e3-8872-f43479309606 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:48 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:02:48 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-29f46c00-12a4-4c56-b800-4e7171a6ca94 tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-29f46c00-12a4-4c56-b800-4e7171a6ca94 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:48 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-29f46c00-12a4-4c56-b800-4e7171a6ca94 tempest-CreateVolumesFromSnapshotTest-438369082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:48 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-29f46c00-12a4-4c56-b800-4e7171a6ca94 tempest-CreateVolumesFromSnapshotTest-438369082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-29f46c00-12a4-4c56-b800-4e7171a6ca94 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-29f46c00-12a4-4c56-b800-4e7171a6ca94 tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:48 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:02:48 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:49 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_22af2b72-49b1-4c9c-8300-47374067ec7d_ciwdga8mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-221142d1-6e91-4781-8614-84195c1526c1" returned: 0 in 0.692s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:49 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_22af2b72-49b1-4c9c-8300-47374067ec7d_ciwdga8mdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-221142d1-6e91-4781-8614-84195c1526c1 {{(pid=88093) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 20:02:49 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Converted 0.00 MB image at 0.00 MB/s Sep 10 20:02:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-221142d1-6e91-4781-8614-84195c1526c1 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:49 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-221142d1-6e91-4781-8614-84195c1526c1 1G Sep 10 20:02:49 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:49 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b1475145-6f33-41e3-8872-f43479309606 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.388s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:49 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-b1475145-6f33-41e3-8872-f43479309606 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:02:49 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-b1475145-6f33-41e3-8872-f43479309606 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Deleted volume successfully. Sep 10 20:02:49 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-29f46c00-12a4-4c56-b800-4e7171a6ca94 tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.357s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:49 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-29f46c00-12a4-4c56-b800-4e7171a6ca94 tempest-CreateVolumesFromSnapshotTest-438369082 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:02:49 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-29f46c00-12a4-4c56-b800-4e7171a6ca94 tempest-CreateVolumesFromSnapshotTest-438369082 None] Deleted volume successfully. Sep 10 20:02:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b1475145-6f33-41e3-8872-f43479309606 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "cinder-3ef43e85-c186-4d52-bb88-bec34e81d1b2-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-29f46c00-12a4-4c56-b800-4e7171a6ca94 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "cinder-baf69e90-7445-4d86-b465-d6f861d366f2-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:49 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-221142d1-6e91-4781-8614-84195c1526c1 1G" returned: 0 in 0.391s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:49 devstack cinder-volume[88093]: DEBUG cinder.volume.volume_utils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Downloaded image 22af2b72-49b1-4c9c-8300-47374067ec7d ((None, [{'url': 'file:///opt/stack/data/glance/images/22af2b72-49b1-4c9c-8300-47374067ec7d', 'metadata': {}}])) to volume 221142d1-6e91-4781-8614-84195c1526c1 successfully. {{(pid=88093) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 20:02:49 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Temporary image 22af2b72-49b1-4c9c-8300-47374067ec7d for user 2774d73bb67d45278ca5e6fb60197f0b is deleted. {{(pid=88093) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 20:02:49 devstack cinder-volume[88093]: DEBUG cinder.volume.volume_utils [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Marking volume 221142d1-6e91-4781-8614-84195c1526c1 as bootable. {{(pid=88093) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 20:02:49 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Copying metadata from image 22af2b72-49b1-4c9c-8300-47374067ec7d to 221142d1-6e91-4781-8614-84195c1526c1. {{(pid=88093) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 20:02:49 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Creating volume glance metadata for volume 221142d1-6e91-4781-8614-84195c1526c1 backed by image 22af2b72-49b1-4c9c-8300-47374067ec7d with: {'image_id': '22af2b72-49b1-4c9c-8300-47374067ec7d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '33e6f10d605dcf857dc8ff9a9a724925', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88093) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 20:02:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d80a36b-0d32-4a11-b140-5978633af0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-221142d1-6e91-4781-8614-84195c1526c1', 'volume_size': 1, 'image_id': '22af2b72-49b1-4c9c-8300-47374067ec7d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/22af2b72-49b1-4c9c-8300-47374067ec7d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '33e6f10d605dcf857dc8ff9a9a724925', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8f3d44ee34b347deb83d64acc8a9d409', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '79d42d994efe8d44f1989465b1cd8d5221648cdaa66fce994ec50c41bdd0124546a198bc5b27da6f5a93ed612d531bb8754da30e897bacec5e9dd8e0c35197e7', 'id': '22af2b72-49b1-4c9c-8300-47374067ec7d', 'created_at': datetime.datetime(2026, 9, 10, 18, 2, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 18, 2, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/22af2b72-49b1-4c9c-8300-47374067ec7d/file', 'properties': {}}, 'image_service': }' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f41044-66ef-4615-9d21-4120cd63e0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:02:49 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Volume volume-221142d1-6e91-4781-8614-84195c1526c1 (221142d1-6e91-4781-8614-84195c1526c1): created successfully Sep 10 20:02:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f41044-66ef-4615-9d21-4120cd63e0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:02:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Flow 'volume_create_manager' (f2f28014-9911-4b81-a86d-cdf65d6f27d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:02:49 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-2de176dd-74be-4ab7-91f5-5ba152e6624e tempest-VolumeImageDependencyTests-427487835 None] Created volume successfully. Sep 10 20:02:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-47dd75e9-4627-44dd-abca-a3645f0c2756 tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "cinder-4bd2d504-4386-45ae-afbf-40e59c150168-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-47dd75e9-4627-44dd-abca-a3645f0c2756 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "cinder-4bd2d504-4386-45ae-afbf-40e59c150168-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-47dd75e9-4627-44dd-abca-a3645f0c2756 tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "cinder-quobyte-4bd2d504-4386-45ae-afbf-40e59c150168" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-47dd75e9-4627-44dd-abca-a3645f0c2756 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "cinder-quobyte-4bd2d504-4386-45ae-afbf-40e59c150168" acquired by "delete_volume" :: waited 0.022s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-88fae804-5b8e-4cc6-89f6-5360e9a15abf tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Acquiring lock "cinder-2b51d71c-ad81-4fd1-a226-141679431af0-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-88fae804-5b8e-4cc6-89f6-5360e9a15abf tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "cinder-2b51d71c-ad81-4fd1-a226-141679431af0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:49 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d8ac4f-84a5-4d63-bf18-b358475c8d01]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-47dd75e9-4627-44dd-abca-a3645f0c2756 tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4bd2d504-4386-45ae-afbf-40e59c150168 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:50 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-88fae804-5b8e-4cc6-89f6-5360e9a15abf tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Acquiring lock "cinder-quobyte-2b51d71c-ad81-4fd1-a226-141679431af0" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:50 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-88fae804-5b8e-4cc6-89f6-5360e9a15abf tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "cinder-quobyte-2b51d71c-ad81-4fd1-a226-141679431af0" acquired by "delete_volume" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:50 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61049a4-549a-47f1-bfdd-9678ace4e702]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-88fae804-5b8e-4cc6-89f6-5360e9a15abf tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2b51d71c-ad81-4fd1-a226-141679431af0 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:50 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-72c18d0c-a4c7-41ef-a039-af9b6c8fa54f tempest-VolumeImageDependencyTests-427487835 None] Acquiring lock "cinder-221142d1-6e91-4781-8614-84195c1526c1-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:50 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-72c18d0c-a4c7-41ef-a039-af9b6c8fa54f tempest-VolumeImageDependencyTests-427487835 None] Lock "cinder-221142d1-6e91-4781-8614-84195c1526c1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:50 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4bd2d504-4386-45ae-afbf-40e59c150168 Sep 10 20:02:50 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:50 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-72c18d0c-a4c7-41ef-a039-af9b6c8fa54f tempest-VolumeImageDependencyTests-427487835 None] Acquiring lock "cinder-quobyte-221142d1-6e91-4781-8614-84195c1526c1" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:50 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-72c18d0c-a4c7-41ef-a039-af9b6c8fa54f tempest-VolumeImageDependencyTests-427487835 None] Lock "cinder-quobyte-221142d1-6e91-4781-8614-84195c1526c1" acquired by "delete_volume" :: waited 0.038s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:50 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7c4f32-e8e1-4122-830c-4ea722cb531b]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-72c18d0c-a4c7-41ef-a039-af9b6c8fa54f tempest-VolumeImageDependencyTests-427487835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-221142d1-6e91-4781-8614-84195c1526c1 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:50 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2b51d71c-ad81-4fd1-a226-141679431af0 Sep 10 20:02:50 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:50 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-221142d1-6e91-4781-8614-84195c1526c1 Sep 10 20:02:50 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:50 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-47dd75e9-4627-44dd-abca-a3645f0c2756 tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4bd2d504-4386-45ae-afbf-40e59c150168" returned: 0 in 0.573s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-47dd75e9-4627-44dd-abca-a3645f0c2756 tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4bd2d504-4386-45ae-afbf-40e59c150168 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:50 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4bd2d504-4386-45ae-afbf-40e59c150168 Sep 10 20:02:50 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:50 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-88fae804-5b8e-4cc6-89f6-5360e9a15abf tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2b51d71c-ad81-4fd1-a226-141679431af0" returned: 0 in 0.593s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-88fae804-5b8e-4cc6-89f6-5360e9a15abf tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2b51d71c-ad81-4fd1-a226-141679431af0 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:50 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2b51d71c-ad81-4fd1-a226-141679431af0 Sep 10 20:02:50 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:50 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-72c18d0c-a4c7-41ef-a039-af9b6c8fa54f tempest-VolumeImageDependencyTests-427487835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-221142d1-6e91-4781-8614-84195c1526c1" returned: 0 in 0.456s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-72c18d0c-a4c7-41ef-a039-af9b6c8fa54f tempest-VolumeImageDependencyTests-427487835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-221142d1-6e91-4781-8614-84195c1526c1 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:50 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-221142d1-6e91-4781-8614-84195c1526c1 Sep 10 20:02:50 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:50 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-47dd75e9-4627-44dd-abca-a3645f0c2756 tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4bd2d504-4386-45ae-afbf-40e59c150168" returned: 0 in 0.331s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:50 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-47dd75e9-4627-44dd-abca-a3645f0c2756 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "cinder-quobyte-4bd2d504-4386-45ae-afbf-40e59c150168" released by "delete_volume" :: held 0.994s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:50 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-47dd75e9-4627-44dd-abca-a3645f0c2756 tempest-CreateVolumesFromSnapshotTest-438369082 None] Created reservations ['74d9bb1d-5d6b-450d-b410-61efdebd7293', '03319666-7242-4ba8-ba52-9992627d89e3', 'f58514d9-ad8d-49ad-9c26-37a2ddd1e5ed', 'fe3aad64-bed3-459c-8e85-91bf865015ed'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:02:50 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-88fae804-5b8e-4cc6-89f6-5360e9a15abf tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2b51d71c-ad81-4fd1-a226-141679431af0" returned: 0 in 0.301s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:50 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-88fae804-5b8e-4cc6-89f6-5360e9a15abf tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "cinder-quobyte-2b51d71c-ad81-4fd1-a226-141679431af0" released by "delete_volume" :: held 0.954s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:51 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-72c18d0c-a4c7-41ef-a039-af9b6c8fa54f tempest-VolumeImageDependencyTests-427487835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-221142d1-6e91-4781-8614-84195c1526c1" returned: 0 in 0.321s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-47dd75e9-4627-44dd-abca-a3645f0c2756 tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-47dd75e9-4627-44dd-abca-a3645f0c2756 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-47dd75e9-4627-44dd-abca-a3645f0c2756 tempest-CreateVolumesFromSnapshotTest-438369082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-47dd75e9-4627-44dd-abca-a3645f0c2756 tempest-CreateVolumesFromSnapshotTest-438369082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-47dd75e9-4627-44dd-abca-a3645f0c2756 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-47dd75e9-4627-44dd-abca-a3645f0c2756 tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-72c18d0c-a4c7-41ef-a039-af9b6c8fa54f tempest-VolumeImageDependencyTests-427487835 None] Lock "cinder-quobyte-221142d1-6e91-4781-8614-84195c1526c1" released by "delete_volume" :: held 0.903s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-17842ba3-8359-49cb-bd5d-e48bb59d4462 tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "cinder-5f1ada98-7c18-4c17-8fc1-14460a95e85a-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-88fae804-5b8e-4cc6-89f6-5360e9a15abf tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Created reservations ['adba6fa4-a2e8-4707-afbf-06049539d6cd', 'faf79dbd-fe96-4aec-b83e-684d47381f5e', 'd86c6383-3dfd-48ec-91f0-2c19b8441306', '2d6dc519-ec23-4350-b294-d8c3c33cb8e9'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:02:51 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:02:51 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-17842ba3-8359-49cb-bd5d-e48bb59d4462 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "cinder-5f1ada98-7c18-4c17-8fc1-14460a95e85a-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-17842ba3-8359-49cb-bd5d-e48bb59d4462 tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "cinder-quobyte-5f1ada98-7c18-4c17-8fc1-14460a95e85a" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-88fae804-5b8e-4cc6-89f6-5360e9a15abf tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-88fae804-5b8e-4cc6-89f6-5360e9a15abf tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-88fae804-5b8e-4cc6-89f6-5360e9a15abf tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-88fae804-5b8e-4cc6-89f6-5360e9a15abf tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-88fae804-5b8e-4cc6-89f6-5360e9a15abf tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-88fae804-5b8e-4cc6-89f6-5360e9a15abf tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-17842ba3-8359-49cb-bd5d-e48bb59d4462 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "cinder-quobyte-5f1ada98-7c18-4c17-8fc1-14460a95e85a" acquired by "delete_volume" :: waited 0.056s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:51 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:02:51 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-72c18d0c-a4c7-41ef-a039-af9b6c8fa54f tempest-VolumeImageDependencyTests-427487835 None] Created reservations ['90ebf536-63f8-456c-aaaa-29e140e7baca', '1f3c6a97-e8b3-427e-b5ce-f5f783c0a83b', '896b0b2a-aa98-4778-b14b-3e84a1003005', 'e3f40ec2-1eb5-4c33-8cd3-dffd20ea575b'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[4565630e-ba1f-4fb0-8c78-4c710fd1ea83]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-17842ba3-8359-49cb-bd5d-e48bb59d4462 tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5f1ada98-7c18-4c17-8fc1-14460a95e85a {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:51 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-47dd75e9-4627-44dd-abca-a3645f0c2756 tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.412s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-47dd75e9-4627-44dd-abca-a3645f0c2756 tempest-CreateVolumesFromSnapshotTest-438369082 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:02:51 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-47dd75e9-4627-44dd-abca-a3645f0c2756 tempest-CreateVolumesFromSnapshotTest-438369082 None] Deleted volume successfully. Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-72c18d0c-a4c7-41ef-a039-af9b6c8fa54f tempest-VolumeImageDependencyTests-427487835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-72c18d0c-a4c7-41ef-a039-af9b6c8fa54f tempest-VolumeImageDependencyTests-427487835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-72c18d0c-a4c7-41ef-a039-af9b6c8fa54f tempest-VolumeImageDependencyTests-427487835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-72c18d0c-a4c7-41ef-a039-af9b6c8fa54f tempest-VolumeImageDependencyTests-427487835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-72c18d0c-a4c7-41ef-a039-af9b6c8fa54f tempest-VolumeImageDependencyTests-427487835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-72c18d0c-a4c7-41ef-a039-af9b6c8fa54f tempest-VolumeImageDependencyTests-427487835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:51 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5f1ada98-7c18-4c17-8fc1-14460a95e85a Sep 10 20:02:51 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:51 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:02:51 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-47dd75e9-4627-44dd-abca-a3645f0c2756 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "cinder-4bd2d504-4386-45ae-afbf-40e59c150168-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:51 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-88fae804-5b8e-4cc6-89f6-5360e9a15abf tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.351s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-88fae804-5b8e-4cc6-89f6-5360e9a15abf tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:02:51 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-88fae804-5b8e-4cc6-89f6-5360e9a15abf tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Deleted volume successfully. Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-88fae804-5b8e-4cc6-89f6-5360e9a15abf tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "cinder-2b51d71c-ad81-4fd1-a226-141679431af0-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:51 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-72c18d0c-a4c7-41ef-a039-af9b6c8fa54f tempest-VolumeImageDependencyTests-427487835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.285s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-72c18d0c-a4c7-41ef-a039-af9b6c8fa54f tempest-VolumeImageDependencyTests-427487835 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:02:51 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-72c18d0c-a4c7-41ef-a039-af9b6c8fa54f tempest-VolumeImageDependencyTests-427487835 None] Deleted volume successfully. Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-72c18d0c-a4c7-41ef-a039-af9b6c8fa54f tempest-VolumeImageDependencyTests-427487835 None] Lock "cinder-221142d1-6e91-4781-8614-84195c1526c1-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:51 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-17842ba3-8359-49cb-bd5d-e48bb59d4462 tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5f1ada98-7c18-4c17-8fc1-14460a95e85a" returned: 0 in 0.508s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-17842ba3-8359-49cb-bd5d-e48bb59d4462 tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5f1ada98-7c18-4c17-8fc1-14460a95e85a {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:51 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5f1ada98-7c18-4c17-8fc1-14460a95e85a Sep 10 20:02:51 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:52 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-17842ba3-8359-49cb-bd5d-e48bb59d4462 tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5f1ada98-7c18-4c17-8fc1-14460a95e85a" returned: 0 in 0.269s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-17842ba3-8359-49cb-bd5d-e48bb59d4462 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "cinder-quobyte-5f1ada98-7c18-4c17-8fc1-14460a95e85a" released by "delete_volume" :: held 0.850s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:52 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-17842ba3-8359-49cb-bd5d-e48bb59d4462 tempest-CreateVolumesFromSnapshotTest-438369082 None] Created reservations ['acf0b61c-bcc6-46fb-8b4f-620750bcdb7f', 'c748d87a-7518-4ea0-aef8-24a26c6ac6a5', 'afd30d1f-4198-4cd8-a37c-00e283849d31', '15b336ef-d378-4ccb-a329-55e8c75c1cc2'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:02:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-975dd553-50cf-4935-af6f-3bea62ebdb55 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Acquiring lock "cinder-803ca3bd-473d-46fd-8ca6-426440888d3b-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-975dd553-50cf-4935-af6f-3bea62ebdb55 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "cinder-803ca3bd-473d-46fd-8ca6-426440888d3b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-17842ba3-8359-49cb-bd5d-e48bb59d4462 tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-17842ba3-8359-49cb-bd5d-e48bb59d4462 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:52 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-17842ba3-8359-49cb-bd5d-e48bb59d4462 tempest-CreateVolumesFromSnapshotTest-438369082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:52 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-17842ba3-8359-49cb-bd5d-e48bb59d4462 tempest-CreateVolumesFromSnapshotTest-438369082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-17842ba3-8359-49cb-bd5d-e48bb59d4462 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-17842ba3-8359-49cb-bd5d-e48bb59d4462 tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-975dd553-50cf-4935-af6f-3bea62ebdb55 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Acquiring lock "cinder-quobyte-803ca3bd-473d-46fd-8ca6-426440888d3b" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:52 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:02:52 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-975dd553-50cf-4935-af6f-3bea62ebdb55 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "cinder-quobyte-803ca3bd-473d-46fd-8ca6-426440888d3b" acquired by "delete_volume" :: waited 0.026s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:52 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[358c0dc5-581c-41cf-a952-a1b2fa9243e6]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-975dd553-50cf-4935-af6f-3bea62ebdb55 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-803ca3bd-473d-46fd-8ca6-426440888d3b {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:52 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-803ca3bd-473d-46fd-8ca6-426440888d3b Sep 10 20:02:52 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:52 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-17842ba3-8359-49cb-bd5d-e48bb59d4462 tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.336s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:52 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-17842ba3-8359-49cb-bd5d-e48bb59d4462 tempest-CreateVolumesFromSnapshotTest-438369082 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:02:52 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-17842ba3-8359-49cb-bd5d-e48bb59d4462 tempest-CreateVolumesFromSnapshotTest-438369082 None] Deleted volume successfully. Sep 10 20:02:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-17842ba3-8359-49cb-bd5d-e48bb59d4462 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "cinder-5f1ada98-7c18-4c17-8fc1-14460a95e85a-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:52 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-975dd553-50cf-4935-af6f-3bea62ebdb55 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-803ca3bd-473d-46fd-8ca6-426440888d3b" returned: 0 in 0.458s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-975dd553-50cf-4935-af6f-3bea62ebdb55 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-803ca3bd-473d-46fd-8ca6-426440888d3b {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:53 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-803ca3bd-473d-46fd-8ca6-426440888d3b Sep 10 20:02:53 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:53 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-975dd553-50cf-4935-af6f-3bea62ebdb55 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-803ca3bd-473d-46fd-8ca6-426440888d3b" returned: 0 in 0.306s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-975dd553-50cf-4935-af6f-3bea62ebdb55 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "cinder-quobyte-803ca3bd-473d-46fd-8ca6-426440888d3b" released by "delete_volume" :: held 0.833s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:53 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-975dd553-50cf-4935-af6f-3bea62ebdb55 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Created reservations ['9d289f66-dd77-41e8-b9da-6c37156acca0', '7740b977-a1d8-4a87-ba16-5837c91288b4', '7b020a4d-66ee-4d30-8023-0ece95247638', 'e4d9e9b2-8749-4212-9a79-9643bf47a649'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:02:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e130e64d-4f1f-4e76-9586-81d51205d250 tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "cinder-fd893d42-d83b-4794-ba4c-73af57e38dfa-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e130e64d-4f1f-4e76-9586-81d51205d250 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "cinder-fd893d42-d83b-4794-ba4c-73af57e38dfa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e130e64d-4f1f-4e76-9586-81d51205d250 tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "cinder-quobyte-d8837206-5363-4738-bc92-a509c06e6628" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-975dd553-50cf-4935-af6f-3bea62ebdb55 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-975dd553-50cf-4935-af6f-3bea62ebdb55 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:53 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-975dd553-50cf-4935-af6f-3bea62ebdb55 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:53 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-975dd553-50cf-4935-af6f-3bea62ebdb55 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-975dd553-50cf-4935-af6f-3bea62ebdb55 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-975dd553-50cf-4935-af6f-3bea62ebdb55 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e130e64d-4f1f-4e76-9586-81d51205d250 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "cinder-quobyte-d8837206-5363-4738-bc92-a509c06e6628" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e130e64d-4f1f-4e76-9586-81d51205d250 tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "cinder-quobyte-fd893d42-d83b-4794-ba4c-73af57e38dfa" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:53 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:02:53 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e130e64d-4f1f-4e76-9586-81d51205d250 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "cinder-quobyte-fd893d42-d83b-4794-ba4c-73af57e38dfa" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:53 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-e130e64d-4f1f-4e76-9586-81d51205d250 tempest-CreateVolumesFromSnapshotTest-438369082 None] Deleting offline snapshot fd893d42-d83b-4794-ba4c-73af57e38dfa of volume d8837206-5363-4738-bc92-a509c06e6628 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:02:53 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-e130e64d-4f1f-4e76-9586-81d51205d250 tempest-CreateVolumesFromSnapshotTest-438369082 None] snapshot_file for this snap is: volume-d8837206-5363-4738-bc92-a509c06e6628.fd893d42-d83b-4794-ba4c-73af57e38dfa {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:02:53 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a55922-88a0-4dd2-923c-cf63d0168df7]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e130e64d-4f1f-4e76-9586-81d51205d250 tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628.fd893d42-d83b-4794-ba4c-73af57e38dfa {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:53 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628.fd893d42-d83b-4794-ba4c-73af57e38dfa Sep 10 20:02:53 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:53 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-975dd553-50cf-4935-af6f-3bea62ebdb55 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.354s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:53 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-975dd553-50cf-4935-af6f-3bea62ebdb55 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:02:53 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-975dd553-50cf-4935-af6f-3bea62ebdb55 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Deleted volume successfully. Sep 10 20:02:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-975dd553-50cf-4935-af6f-3bea62ebdb55 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "cinder-803ca3bd-473d-46fd-8ca6-426440888d3b-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:54 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e130e64d-4f1f-4e76-9586-81d51205d250 tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628.fd893d42-d83b-4794-ba4c-73af57e38dfa" returned: 0 in 0.425s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:54 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-e130e64d-4f1f-4e76-9586-81d51205d250 tempest-CreateVolumesFromSnapshotTest-438369082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8837206-5363-4738-bc92-a509c06e6628(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:02:54 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65ebbbe-fc13-4b85-a302-58103eb31c40]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e130e64d-4f1f-4e76-9586-81d51205d250 tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:54 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628 Sep 10 20:02:54 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:54 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e130e64d-4f1f-4e76-9586-81d51205d250 tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628" returned: 0 in 0.466s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e130e64d-4f1f-4e76-9586-81d51205d250 tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628.fd893d42-d83b-4794-ba4c-73af57e38dfa {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:54 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628.fd893d42-d83b-4794-ba4c-73af57e38dfa Sep 10 20:02:54 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:54 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-618829ea-09e0-479d-9a19-c39d615a3d63 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Acquiring lock "cinder-1bb0daf2-3a72-4c08-976f-38484a7bca07-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:54 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-618829ea-09e0-479d-9a19-c39d615a3d63 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "cinder-1bb0daf2-3a72-4c08-976f-38484a7bca07-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:54 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-618829ea-09e0-479d-9a19-c39d615a3d63 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Acquiring lock "cinder-quobyte-1bb0daf2-3a72-4c08-976f-38484a7bca07" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:54 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-618829ea-09e0-479d-9a19-c39d615a3d63 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "cinder-quobyte-1bb0daf2-3a72-4c08-976f-38484a7bca07" acquired by "delete_volume" :: waited 0.063s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:54 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[618f0c56-c4a2-47f2-bcc5-2df80a7d9031]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-618829ea-09e0-479d-9a19-c39d615a3d63 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1bb0daf2-3a72-4c08-976f-38484a7bca07 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:55 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1bb0daf2-3a72-4c08-976f-38484a7bca07 Sep 10 20:02:55 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:55 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e130e64d-4f1f-4e76-9586-81d51205d250 tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628.fd893d42-d83b-4794-ba4c-73af57e38dfa" returned: 0 in 0.703s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e130e64d-4f1f-4e76-9586-81d51205d250 tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628.fd893d42-d83b-4794-ba4c-73af57e38dfa {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:55 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628.fd893d42-d83b-4794-ba4c-73af57e38dfa Sep 10 20:02:55 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:55 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e130e64d-4f1f-4e76-9586-81d51205d250 tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628.fd893d42-d83b-4794-ba4c-73af57e38dfa" returned: 0 in 0.390s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:55 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-618829ea-09e0-479d-9a19-c39d615a3d63 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1bb0daf2-3a72-4c08-976f-38484a7bca07" returned: 0 in 0.778s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-618829ea-09e0-479d-9a19-c39d615a3d63 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1bb0daf2-3a72-4c08-976f-38484a7bca07 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:55 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e130e64d-4f1f-4e76-9586-81d51205d250 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "cinder-quobyte-fd893d42-d83b-4794-ba4c-73af57e38dfa" released by "_delete_snapshot" :: held 2.146s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:55 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e130e64d-4f1f-4e76-9586-81d51205d250 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "cinder-quobyte-d8837206-5363-4738-bc92-a509c06e6628" released by "delete_snapshot" :: held 2.189s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:55 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1bb0daf2-3a72-4c08-976f-38484a7bca07 Sep 10 20:02:55 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:55 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-e130e64d-4f1f-4e76-9586-81d51205d250 tempest-CreateVolumesFromSnapshotTest-438369082 None] Created reservations ['e1554f6e-8f16-40b4-8347-24c7e06dee0c', 'c547be5f-7b0e-43d1-9842-25273bbe4d7e', '56f51158-b38c-4be5-a8e1-882a97b3cab8', 'a268a3e1-7ca2-4132-a23a-3ebc3b90cf85'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:02:55 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-e130e64d-4f1f-4e76-9586-81d51205d250 tempest-CreateVolumesFromSnapshotTest-438369082 None] Delete snapshot completed successfully. Sep 10 20:02:55 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-e130e64d-4f1f-4e76-9586-81d51205d250 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "cinder-fd893d42-d83b-4794-ba4c-73af57e38dfa-delete_snapshot" released by "delete_snapshot" :: held 2.456s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:56 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-618829ea-09e0-479d-9a19-c39d615a3d63 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1bb0daf2-3a72-4c08-976f-38484a7bca07" returned: 0 in 0.438s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:56 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-618829ea-09e0-479d-9a19-c39d615a3d63 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "cinder-quobyte-1bb0daf2-3a72-4c08-976f-38484a7bca07" released by "delete_volume" :: held 1.313s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:56 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-618829ea-09e0-479d-9a19-c39d615a3d63 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Created reservations ['1766b661-23e8-4ac8-8d68-cf0f45b54df3', 'e6e2602e-571a-4285-b95d-49f1c9c0b9ad', 'ead388e6-7ead-4e15-b46f-219fefb48549', 'c13cc6e6-d100-4300-81b2-eb6a00ae4ae5'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:02:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-618829ea-09e0-479d-9a19-c39d615a3d63 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-618829ea-09e0-479d-9a19-c39d615a3d63 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-618829ea-09e0-479d-9a19-c39d615a3d63 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-618829ea-09e0-479d-9a19-c39d615a3d63 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-618829ea-09e0-479d-9a19-c39d615a3d63 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-618829ea-09e0-479d-9a19-c39d615a3d63 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:56 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:02:56 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:56 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-618829ea-09e0-479d-9a19-c39d615a3d63 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.409s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:56 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-618829ea-09e0-479d-9a19-c39d615a3d63 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:02:56 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-618829ea-09e0-479d-9a19-c39d615a3d63 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Deleted volume successfully. Sep 10 20:02:56 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cab2a13a-9b23-447b-8be2-f7969b711239 tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "cinder-d8837206-5363-4738-bc92-a509c06e6628-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:56 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cab2a13a-9b23-447b-8be2-f7969b711239 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "cinder-d8837206-5363-4738-bc92-a509c06e6628-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:56 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-618829ea-09e0-479d-9a19-c39d615a3d63 tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "cinder-1bb0daf2-3a72-4c08-976f-38484a7bca07-delete_volume" released by "delete_volume" :: held 2.163s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:56 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cab2a13a-9b23-447b-8be2-f7969b711239 tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "cinder-quobyte-d8837206-5363-4738-bc92-a509c06e6628" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:56 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cab2a13a-9b23-447b-8be2-f7969b711239 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "cinder-quobyte-d8837206-5363-4738-bc92-a509c06e6628" acquired by "delete_volume" :: waited 0.023s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:57 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[957e6cb7-6205-40a8-bbf0-2811502ce140]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cab2a13a-9b23-447b-8be2-f7969b711239 tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:57 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-951310d2-139b-4b04-80dd-7309141ff16e tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Acquiring lock "cinder-7ede0d65-1c51-4754-87e7-6d0b304b8236-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:57 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-951310d2-139b-4b04-80dd-7309141ff16e tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "cinder-7ede0d65-1c51-4754-87e7-6d0b304b8236-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:57 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628 Sep 10 20:02:57 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:57 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-951310d2-139b-4b04-80dd-7309141ff16e tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Acquiring lock "cinder-quobyte-7ede0d65-1c51-4754-87e7-6d0b304b8236" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:02:57 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-951310d2-139b-4b04-80dd-7309141ff16e tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "cinder-quobyte-7ede0d65-1c51-4754-87e7-6d0b304b8236" acquired by "delete_volume" :: waited 0.059s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:02:57 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[d086a572-3157-4965-8e92-4943748a7799]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:02:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-951310d2-139b-4b04-80dd-7309141ff16e tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ede0d65-1c51-4754-87e7-6d0b304b8236 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-8d94b2ea-5ce2-4333-9efe-59f934ae7a20 tempest-ProjectAdminTests-1515098557 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.2748527526855, 'free_capacity_gb': 1773.2748527526855, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88093) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 10 20:02:57 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ede0d65-1c51-4754-87e7-6d0b304b8236 Sep 10 20:02:57 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:57 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cab2a13a-9b23-447b-8be2-f7969b711239 tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628" returned: 0 in 0.682s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cab2a13a-9b23-447b-8be2-f7969b711239 tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:57 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628 Sep 10 20:02:57 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:57 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-951310d2-139b-4b04-80dd-7309141ff16e tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ede0d65-1c51-4754-87e7-6d0b304b8236" returned: 0 in 0.588s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-951310d2-139b-4b04-80dd-7309141ff16e tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ede0d65-1c51-4754-87e7-6d0b304b8236 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:58 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ede0d65-1c51-4754-87e7-6d0b304b8236 Sep 10 20:02:58 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:58 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cab2a13a-9b23-447b-8be2-f7969b711239 tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-d8837206-5363-4738-bc92-a509c06e6628" returned: 0 in 0.526s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:58 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cab2a13a-9b23-447b-8be2-f7969b711239 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "cinder-quobyte-d8837206-5363-4738-bc92-a509c06e6628" released by "delete_volume" :: held 1.344s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:58 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-cab2a13a-9b23-447b-8be2-f7969b711239 tempest-CreateVolumesFromSnapshotTest-438369082 None] Created reservations ['77dfadc1-b50d-400d-b444-ae8d17c79e8b', '4a2b6564-4fd7-43fc-91c4-8b48a807a74a', '02b4e451-300b-4339-96e9-2cbca09d5357', '374c5c3f-636f-4262-b25f-39b7b2e99f74'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:02:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cab2a13a-9b23-447b-8be2-f7969b711239 tempest-CreateVolumesFromSnapshotTest-438369082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cab2a13a-9b23-447b-8be2-f7969b711239 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:58 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-cab2a13a-9b23-447b-8be2-f7969b711239 tempest-CreateVolumesFromSnapshotTest-438369082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:58 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-cab2a13a-9b23-447b-8be2-f7969b711239 tempest-CreateVolumesFromSnapshotTest-438369082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cab2a13a-9b23-447b-8be2-f7969b711239 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cab2a13a-9b23-447b-8be2-f7969b711239 tempest-CreateVolumesFromSnapshotTest-438369082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:58 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:58 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:02:58 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-951310d2-139b-4b04-80dd-7309141ff16e tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-7ede0d65-1c51-4754-87e7-6d0b304b8236" returned: 0 in 0.585s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:58 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-951310d2-139b-4b04-80dd-7309141ff16e tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "cinder-quobyte-7ede0d65-1c51-4754-87e7-6d0b304b8236" released by "delete_volume" :: held 1.248s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:58 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-951310d2-139b-4b04-80dd-7309141ff16e tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Created reservations ['af0b8a35-30a5-49b5-aa78-980c6ee5d75d', '2f75a8df-024f-470f-a373-a39e104c4bd3', '3a6068b9-68be-4856-a553-7f21198df69c', '91af9b8b-0176-4fab-a365-5f28b302f2b4'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:02:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-951310d2-139b-4b04-80dd-7309141ff16e tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:02:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-951310d2-139b-4b04-80dd-7309141ff16e tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:02:58 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-951310d2-139b-4b04-80dd-7309141ff16e tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:02:58 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-951310d2-139b-4b04-80dd-7309141ff16e tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:02:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-951310d2-139b-4b04-80dd-7309141ff16e tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:02:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-951310d2-139b-4b04-80dd-7309141ff16e tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:58 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:02:58 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:58 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cab2a13a-9b23-447b-8be2-f7969b711239 tempest-CreateVolumesFromSnapshotTest-438369082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.357s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:58 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-cab2a13a-9b23-447b-8be2-f7969b711239 tempest-CreateVolumesFromSnapshotTest-438369082 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:02:58 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-cab2a13a-9b23-447b-8be2-f7969b711239 tempest-CreateVolumesFromSnapshotTest-438369082 None] Deleted volume successfully. Sep 10 20:02:58 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cab2a13a-9b23-447b-8be2-f7969b711239 tempest-CreateVolumesFromSnapshotTest-438369082 None] Lock "cinder-d8837206-5363-4738-bc92-a509c06e6628-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:02:59 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-951310d2-139b-4b04-80dd-7309141ff16e tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.393s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:59 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-951310d2-139b-4b04-80dd-7309141ff16e tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:02:59 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-951310d2-139b-4b04-80dd-7309141ff16e tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Deleted volume successfully. Sep 10 20:02:59 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-951310d2-139b-4b04-80dd-7309141ff16e tempest-CreateVolumesFromSourceVolumeTest-1108936093 None] Lock "cinder-7ede0d65-1c51-4754-87e7-6d0b304b8236-delete_volume" released by "delete_volume" :: held 2.079s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:03 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:03:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:03:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:03:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:04 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:03:04 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:04 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.405s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:04 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:03:04 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager._thread_info {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:03:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread count: 28 {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:03:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread info: [<_MainThread(MainThread, started 138417491665024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:03:07 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=217,cinder:UPDATE=260,cinder:INSERT=74,cinder:DELETE=26 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:03:07 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:UPDATE=296,cinder:SELECT=187,cinder:INSERT=75,cinder:DELETE=23 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:03:07 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:03:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] Flow 'volume_create_manager' (3988b55e-4a4e-4611-8016-a5f52970a6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:03:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed65e16b-248f-45e2-82c7-77e7debc37a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed65e16b-248f-45e2-82c7-77e7debc37a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-108733575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb56303-4269-442b-bc0a-f490d4e71f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='136e244d2c7640dbb671275ace71e077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:03:07Z,use_quota=True,user_id='cab4f1f15afe44ce99da72ab407551ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a512870-7c71-494b-a164-f9839cf1f254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a512870-7c71-494b-a164-f9839cf1f254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e4f068b-665a-42b7-ac69-200d98a84c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e4f068b-665a-42b7-ac69-200d98a84c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fb56303-4269-442b-bc0a-f490d4e71f8b', 'volume_name': 'volume-8fb56303-4269-442b-bc0a-f490d4e71f8b', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2980d203-3158-4c24-9f28-3aca8cd5adef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2980d203-3158-4c24-9f28-3aca8cd5adef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:07 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (140fff83-02fa-4f39-9e63-96b0d5cedd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:07 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] Volume 8fb56303-4269-442b-bc0a-f490d4e71f8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fb56303-4269-442b-bc0a-f490d4e71f8b', 'volume_size': 1} Sep 10 20:03:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-108733575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb56303-4269-442b-bc0a-f490d4e71f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='136e244d2c7640dbb671275ace71e077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:03:07Z,use_quota=True,user_id='cab4f1f15afe44ce99da72ab407551ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:03:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] Creating volume 8fb56303-4269-442b-bc0a-f490d4e71f8b {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:03:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:03:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:03:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:03:07 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:03:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8fb56303-4269-442b-bc0a-f490d4e71f8b 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:07 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8fb56303-4269-442b-bc0a-f490d4e71f8b 1073741824 Sep 10 20:03:07 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:07 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8fb56303-4269-442b-bc0a-f490d4e71f8b 1073741824" returned: 0 in 0.594s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8fb56303-4269-442b-bc0a-f490d4e71f8b {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:08 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8fb56303-4269-442b-bc0a-f490d4e71f8b Sep 10 20:03:08 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:08 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8fb56303-4269-442b-bc0a-f490d4e71f8b" returned: 0 in 0.383s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:08 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:03:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (140fff83-02fa-4f39-9e63-96b0d5cedd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fb56303-4269-442b-bc0a-f490d4e71f8b', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd5cf6ff-7af0-439d-820f-06a051d77066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:08 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] Volume volume-8fb56303-4269-442b-bc0a-f490d4e71f8b (8fb56303-4269-442b-bc0a-f490d4e71f8b): created successfully Sep 10 20:03:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd5cf6ff-7af0-439d-820f-06a051d77066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:08 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] Flow 'volume_create_manager' (3988b55e-4a4e-4611-8016-a5f52970a6dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:03:08 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-19fa429a-dc42-44b7-82fb-f9a2c3d2897a tempest-ProjectReaderTests-648861341 None] Created volume successfully. Sep 10 20:03:09 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f64db661-9efd-476e-9523-7f9d838aba21 tempest-ProjectReaderTests-648861341 None] Acquiring lock "cinder-8fb56303-4269-442b-bc0a-f490d4e71f8b-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:09 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f64db661-9efd-476e-9523-7f9d838aba21 tempest-ProjectReaderTests-648861341 None] Lock "cinder-8fb56303-4269-442b-bc0a-f490d4e71f8b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:09 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f64db661-9efd-476e-9523-7f9d838aba21 tempest-ProjectReaderTests-648861341 None] Acquiring lock "cinder-quobyte-8fb56303-4269-442b-bc0a-f490d4e71f8b" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:09 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f64db661-9efd-476e-9523-7f9d838aba21 tempest-ProjectReaderTests-648861341 None] Lock "cinder-quobyte-8fb56303-4269-442b-bc0a-f490d4e71f8b" acquired by "delete_volume" :: waited 0.023s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:09 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ad6691-b1fd-4773-80de-ccc5acac5269]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:03:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f64db661-9efd-476e-9523-7f9d838aba21 tempest-ProjectReaderTests-648861341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8fb56303-4269-442b-bc0a-f490d4e71f8b {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:10 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8fb56303-4269-442b-bc0a-f490d4e71f8b Sep 10 20:03:10 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:10 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f64db661-9efd-476e-9523-7f9d838aba21 tempest-ProjectReaderTests-648861341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8fb56303-4269-442b-bc0a-f490d4e71f8b" returned: 0 in 0.451s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f64db661-9efd-476e-9523-7f9d838aba21 tempest-ProjectReaderTests-648861341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8fb56303-4269-442b-bc0a-f490d4e71f8b {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:10 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8fb56303-4269-442b-bc0a-f490d4e71f8b Sep 10 20:03:10 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:10 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f64db661-9efd-476e-9523-7f9d838aba21 tempest-ProjectReaderTests-648861341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-8fb56303-4269-442b-bc0a-f490d4e71f8b" returned: 0 in 0.374s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f64db661-9efd-476e-9523-7f9d838aba21 tempest-ProjectReaderTests-648861341 None] Lock "cinder-quobyte-8fb56303-4269-442b-bc0a-f490d4e71f8b" released by "delete_volume" :: held 0.897s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:10 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-f64db661-9efd-476e-9523-7f9d838aba21 tempest-ProjectReaderTests-648861341 None] Created reservations ['d8af14a5-e8e6-45b3-b1f1-8d83f3e44cd4', 'f8c3129a-e85f-4e96-8293-23111def38a6', 'cd93968d-7164-40d6-a066-239e9b7c31fb', '6e2b148d-e86f-4b03-b9cc-5aa9297a762f'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:03:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f64db661-9efd-476e-9523-7f9d838aba21 tempest-ProjectReaderTests-648861341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f64db661-9efd-476e-9523-7f9d838aba21 tempest-ProjectReaderTests-648861341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:10 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f64db661-9efd-476e-9523-7f9d838aba21 tempest-ProjectReaderTests-648861341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:03:10 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f64db661-9efd-476e-9523-7f9d838aba21 tempest-ProjectReaderTests-648861341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:03:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f64db661-9efd-476e-9523-7f9d838aba21 tempest-ProjectReaderTests-648861341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f64db661-9efd-476e-9523-7f9d838aba21 tempest-ProjectReaderTests-648861341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:10 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:03:10 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:11 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f64db661-9efd-476e-9523-7f9d838aba21 tempest-ProjectReaderTests-648861341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.332s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:11 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-f64db661-9efd-476e-9523-7f9d838aba21 tempest-ProjectReaderTests-648861341 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:03:11 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-f64db661-9efd-476e-9523-7f9d838aba21 tempest-ProjectReaderTests-648861341 None] Deleted volume successfully. Sep 10 20:03:11 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-f64db661-9efd-476e-9523-7f9d838aba21 tempest-ProjectReaderTests-648861341 None] Lock "cinder-8fb56303-4269-442b-bc0a-f490d4e71f8b-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:11 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:03:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] Flow 'volume_create_manager' (b139356d-6046-4851-a8be-45e62e9af61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:03:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b08d16-c33c-4295-a1da-2e2997342c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b08d16-c33c-4295-a1da-2e2997342c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-680640395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e57f85d4-7948-412f-a1d4-3acde1f9ffb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='136e244d2c7640dbb671275ace71e077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:03:12Z,use_quota=True,user_id='cab4f1f15afe44ce99da72ab407551ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c91c14c-6aa2-4d01-aaf3-d654b65706f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c91c14c-6aa2-4d01-aaf3-d654b65706f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b71dc17e-8a52-4faa-95e5-343a939d8433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b71dc17e-8a52-4faa-95e5-343a939d8433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e57f85d4-7948-412f-a1d4-3acde1f9ffb8', 'volume_name': 'volume-e57f85d4-7948-412f-a1d4-3acde1f9ffb8', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf18e2f-fd84-492e-94b1-0acc765e8d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf18e2f-fd84-492e-94b1-0acc765e8d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2eac662-f18f-4634-8f09-89422c1a986a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:11 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] Volume e57f85d4-7948-412f-a1d4-3acde1f9ffb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e57f85d4-7948-412f-a1d4-3acde1f9ffb8', 'volume_size': 1} Sep 10 20:03:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-680640395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e57f85d4-7948-412f-a1d4-3acde1f9ffb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='136e244d2c7640dbb671275ace71e077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:03:12Z,use_quota=True,user_id='cab4f1f15afe44ce99da72ab407551ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:03:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] Creating volume e57f85d4-7948-412f-a1d4-3acde1f9ffb8 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:03:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:03:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:03:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:03:11 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:03:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e57f85d4-7948-412f-a1d4-3acde1f9ffb8 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:11 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e57f85d4-7948-412f-a1d4-3acde1f9ffb8 1073741824 Sep 10 20:03:11 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:12 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e57f85d4-7948-412f-a1d4-3acde1f9ffb8 1073741824" returned: 0 in 0.662s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e57f85d4-7948-412f-a1d4-3acde1f9ffb8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:12 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e57f85d4-7948-412f-a1d4-3acde1f9ffb8 Sep 10 20:03:12 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:13 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e57f85d4-7948-412f-a1d4-3acde1f9ffb8" returned: 0 in 0.415s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:13 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:03:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2eac662-f18f-4634-8f09-89422c1a986a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e57f85d4-7948-412f-a1d4-3acde1f9ffb8', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddeb4d88-cb7c-4871-ae1c-1b0835db6354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:13 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] Volume volume-e57f85d4-7948-412f-a1d4-3acde1f9ffb8 (e57f85d4-7948-412f-a1d4-3acde1f9ffb8): created successfully Sep 10 20:03:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddeb4d88-cb7c-4871-ae1c-1b0835db6354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] Flow 'volume_create_manager' (b139356d-6046-4851-a8be-45e62e9af61b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:03:13 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-1dd273f2-4939-4bc1-81a4-98be70c692ba tempest-ProjectReaderTests-648861341 None] Created volume successfully. Sep 10 20:03:13 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-19f218b2-6354-41f4-a494-9707d5595cd8 tempest-ProjectReaderTests-648861341 None] Acquiring lock "cinder-e57f85d4-7948-412f-a1d4-3acde1f9ffb8-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-19f218b2-6354-41f4-a494-9707d5595cd8 tempest-ProjectReaderTests-648861341 None] Lock "cinder-e57f85d4-7948-412f-a1d4-3acde1f9ffb8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-19f218b2-6354-41f4-a494-9707d5595cd8 tempest-ProjectReaderTests-648861341 None] Acquiring lock "cinder-quobyte-e57f85d4-7948-412f-a1d4-3acde1f9ffb8" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-19f218b2-6354-41f4-a494-9707d5595cd8 tempest-ProjectReaderTests-648861341 None] Lock "cinder-quobyte-e57f85d4-7948-412f-a1d4-3acde1f9ffb8" acquired by "delete_volume" :: waited 0.017s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:14 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de25727-6beb-4d9b-afeb-9b93831016e1]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:03:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-19f218b2-6354-41f4-a494-9707d5595cd8 tempest-ProjectReaderTests-648861341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e57f85d4-7948-412f-a1d4-3acde1f9ffb8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:14 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:03:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] Flow 'volume_create_manager' (32c30b79-a4f7-42f5-856c-7af608bd5548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:03:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b527b3f7-2f9c-4869-aab4-6906aaece5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:14 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e57f85d4-7948-412f-a1d4-3acde1f9ffb8 Sep 10 20:03:14 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b527b3f7-2f9c-4869-aab4-6906aaece5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-826779572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ecf6fa6-99de-4d8e-a303-542312657674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e934bfdc8641078f63f0e9d068a844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:03:14Z,use_quota=True,user_id='fb77e81596394eb99432bed57c5670e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ad0519f-b609-4b9b-bbd8-3f74497b04e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ad0519f-b609-4b9b-bbd8-3f74497b04e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1983b8de-ce0a-4c59-bc42-4120f3117c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1983b8de-ce0a-4c59-bc42-4120f3117c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ecf6fa6-99de-4d8e-a303-542312657674', 'volume_name': 'volume-0ecf6fa6-99de-4d8e-a303-542312657674', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e43ef8-9468-4017-b54d-aabfde92fc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e43ef8-9468-4017-b54d-aabfde92fc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a63d3e7d-8f40-4c80-be6f-c4ceaab07896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:14 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] Volume 0ecf6fa6-99de-4d8e-a303-542312657674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ecf6fa6-99de-4d8e-a303-542312657674', 'volume_size': 1} Sep 10 20:03:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-826779572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ecf6fa6-99de-4d8e-a303-542312657674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e934bfdc8641078f63f0e9d068a844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:03:14Z,use_quota=True,user_id='fb77e81596394eb99432bed57c5670e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:03:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] Creating volume 0ecf6fa6-99de-4d8e-a303-542312657674 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:03:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:03:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:03:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:03:14 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:03:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:14 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674 1073741824 Sep 10 20:03:14 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:14 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-19f218b2-6354-41f4-a494-9707d5595cd8 tempest-ProjectReaderTests-648861341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e57f85d4-7948-412f-a1d4-3acde1f9ffb8" returned: 0 in 0.560s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-19f218b2-6354-41f4-a494-9707d5595cd8 tempest-ProjectReaderTests-648861341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e57f85d4-7948-412f-a1d4-3acde1f9ffb8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:14 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e57f85d4-7948-412f-a1d4-3acde1f9ffb8 Sep 10 20:03:14 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:15 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-19f218b2-6354-41f4-a494-9707d5595cd8 tempest-ProjectReaderTests-648861341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e57f85d4-7948-412f-a1d4-3acde1f9ffb8" returned: 0 in 0.333s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:15 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674 1073741824" returned: 0 in 0.707s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-19f218b2-6354-41f4-a494-9707d5595cd8 tempest-ProjectReaderTests-648861341 None] Lock "cinder-quobyte-e57f85d4-7948-412f-a1d4-3acde1f9ffb8" released by "delete_volume" :: held 0.962s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:15 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674 Sep 10 20:03:15 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:15 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-19f218b2-6354-41f4-a494-9707d5595cd8 tempest-ProjectReaderTests-648861341 None] Created reservations ['04cf5380-f39c-4f3c-937d-5a8f0580dc12', '14398d74-ae8b-4bc4-9133-4371995e1283', '9821ccbe-1adf-4091-8a84-5ecdafe06105', '46cab5a4-b06d-4fee-a497-6a4bb033dc38'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:03:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-19f218b2-6354-41f4-a494-9707d5595cd8 tempest-ProjectReaderTests-648861341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-19f218b2-6354-41f4-a494-9707d5595cd8 tempest-ProjectReaderTests-648861341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:15 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-19f218b2-6354-41f4-a494-9707d5595cd8 tempest-ProjectReaderTests-648861341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:03:15 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-19f218b2-6354-41f4-a494-9707d5595cd8 tempest-ProjectReaderTests-648861341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:03:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-19f218b2-6354-41f4-a494-9707d5595cd8 tempest-ProjectReaderTests-648861341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-19f218b2-6354-41f4-a494-9707d5595cd8 tempest-ProjectReaderTests-648861341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:15 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:03:15 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:15 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674" returned: 0 in 0.380s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:15 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:03:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a63d3e7d-8f40-4c80-be6f-c4ceaab07896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ecf6fa6-99de-4d8e-a303-542312657674', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed05fb74-6295-48db-ba07-fa0003a7ddba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:15 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] Volume volume-0ecf6fa6-99de-4d8e-a303-542312657674 (0ecf6fa6-99de-4d8e-a303-542312657674): created successfully Sep 10 20:03:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed05fb74-6295-48db-ba07-fa0003a7ddba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:15 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] Flow 'volume_create_manager' (32c30b79-a4f7-42f5-856c-7af608bd5548) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:03:15 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-c38d9a5f-b815-4bf4-84f9-e0d94b134dba tempest-ProjectMemberTests-351068705 None] Created volume successfully. Sep 10 20:03:15 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-19f218b2-6354-41f4-a494-9707d5595cd8 tempest-ProjectReaderTests-648861341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.333s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:15 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-19f218b2-6354-41f4-a494-9707d5595cd8 tempest-ProjectReaderTests-648861341 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:03:15 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-19f218b2-6354-41f4-a494-9707d5595cd8 tempest-ProjectReaderTests-648861341 None] Deleted volume successfully. Sep 10 20:03:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-19f218b2-6354-41f4-a494-9707d5595cd8 tempest-ProjectReaderTests-648861341 None] Lock "cinder-e57f85d4-7948-412f-a1d4-3acde1f9ffb8-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3082eb5a-2d04-46dc-b490-e6726f89d4c6 tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3082eb5a-2d04-46dc-b490-e6726f89d4c6 tempest-ProjectMemberTests-351068705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:16 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-3082eb5a-2d04-46dc-b490-e6726f89d4c6 tempest-ProjectMemberTests-351068705 None] Creating offline snapshot e19d63f5-88a9-4c02-b388-5be4f0d5bb1c of volume 0ecf6fa6-99de-4d8e-a303-542312657674 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:03:16 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[444cfab8-d470-4156-8785-a953952a35f8]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:03:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3082eb5a-2d04-46dc-b490-e6726f89d4c6 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:16 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674 Sep 10 20:03:16 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:17 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3082eb5a-2d04-46dc-b490-e6726f89d4c6 tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674" returned: 0 in 0.561s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3082eb5a-2d04-46dc-b490-e6726f89d4c6 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674.e19d63f5-88a9-4c02-b388-5be4f0d5bb1c 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:17 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674.e19d63f5-88a9-4c02-b388-5be4f0d5bb1c 1G Sep 10 20:03:17 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:17 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3082eb5a-2d04-46dc-b490-e6726f89d4c6 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674.e19d63f5-88a9-4c02-b388-5be4f0d5bb1c 1G" returned: 0 in 0.523s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3082eb5a-2d04-46dc-b490-e6726f89d4c6 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ecf6fa6-99de-4d8e-a303-542312657674 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674.e19d63f5-88a9-4c02-b388-5be4f0d5bb1c {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:17 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ecf6fa6-99de-4d8e-a303-542312657674 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674.e19d63f5-88a9-4c02-b388-5be4f0d5bb1c Sep 10 20:03:17 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:18 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3082eb5a-2d04-46dc-b490-e6726f89d4c6 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ecf6fa6-99de-4d8e-a303-542312657674 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674.e19d63f5-88a9-4c02-b388-5be4f0d5bb1c" returned: 0 in 0.443s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:18 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-3082eb5a-2d04-46dc-b490-e6726f89d4c6 tempest-ProjectMemberTests-351068705 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674.e19d63f5-88a9-4c02-b388-5be4f0d5bb1c is being set with open permissions: ugo+rw Sep 10 20:03:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3082eb5a-2d04-46dc-b490-e6726f89d4c6 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674.e19d63f5-88a9-4c02-b388-5be4f0d5bb1c {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:18 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674.e19d63f5-88a9-4c02-b388-5be4f0d5bb1c Sep 10 20:03:18 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:18 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3082eb5a-2d04-46dc-b490-e6726f89d4c6 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674.e19d63f5-88a9-4c02-b388-5be4f0d5bb1c" returned: 0 in 0.294s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3082eb5a-2d04-46dc-b490-e6726f89d4c6 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:18 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674.info Sep 10 20:03:18 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:18 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:03:18 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] Flow 'volume_create_manager' (3fba03e3-360d-4fdd-bd80-b8a02321c847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:03:18 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69047cef-7ae2-4789-a878-19ee166e0bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:18 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69047cef-7ae2-4789-a878-19ee166e0bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2027540578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca4eeff7ff0348fe97598dd4711fb8fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:03:19Z,use_quota=True,user_id='d803e5bbb12042d4a11e6ca174e28a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:18 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b809ff65-527f-415a-a908-f9b74e9cc962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:18 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b809ff65-527f-415a-a908-f9b74e9cc962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:18 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7532eb95-479e-4ec6-9bf4-87f587847ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:18 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7532eb95-479e-4ec6-9bf4-87f587847ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88', 'volume_name': 'volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:18 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62a4df6c-fb09-494d-90a1-3d18ef65f4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:18 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62a4df6c-fb09-494d-90a1-3d18ef65f4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:18 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1177ca16-9370-4ba7-baf7-57de80597e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:18 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] Volume 9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88', 'volume_size': 1} Sep 10 20:03:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:18 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3082eb5a-2d04-46dc-b490-e6726f89d4c6 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674.info" returned: 0 in 0.313s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:18 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-3082eb5a-2d04-46dc-b490-e6726f89d4c6 tempest-ProjectMemberTests-351068705 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674.info is being set with open permissions: ugo+rw Sep 10 20:03:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3082eb5a-2d04-46dc-b490-e6726f89d4c6 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:19 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674.info Sep 10 20:03:19 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:19 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3082eb5a-2d04-46dc-b490-e6726f89d4c6 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674.info" returned: 0 in 0.298s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3082eb5a-2d04-46dc-b490-e6726f89d4c6 tempest-ProjectMemberTests-351068705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.628s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.425s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:19 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2027540578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca4eeff7ff0348fe97598dd4711fb8fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:03:19Z,use_quota=True,user_id='d803e5bbb12042d4a11e6ca174e28a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:03:19 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] Creating volume 9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:03:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:19 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:03:19 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:03:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:19 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:03:19 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:03:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:19 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88 1073741824 Sep 10 20:03:19 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:19 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-3082eb5a-2d04-46dc-b490-e6726f89d4c6 tempest-ProjectMemberTests-351068705 None] Create snapshot completed successfully Sep 10 20:03:19 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9cc184d6-317d-460e-90ea-3e7434537299 tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-e19d63f5-88a9-4c02-b388-5be4f0d5bb1c-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:19 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:19 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9cc184d6-317d-460e-90ea-3e7434537299 tempest-ProjectMemberTests-351068705 None] Lock "cinder-e19d63f5-88a9-4c02-b388-5be4f0d5bb1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:19 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9cc184d6-317d-460e-90ea-3e7434537299 tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-quobyte-0ecf6fa6-99de-4d8e-a303-542312657674" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88 1073741824" returned: 0 in 0.585s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:19 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9cc184d6-317d-460e-90ea-3e7434537299 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-0ecf6fa6-99de-4d8e-a303-542312657674" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:19 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9cc184d6-317d-460e-90ea-3e7434537299 tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-quobyte-e19d63f5-88a9-4c02-b388-5be4f0d5bb1c" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:19 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9cc184d6-317d-460e-90ea-3e7434537299 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-e19d63f5-88a9-4c02-b388-5be4f0d5bb1c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:19 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-9cc184d6-317d-460e-90ea-3e7434537299 tempest-ProjectMemberTests-351068705 None] Deleting offline snapshot e19d63f5-88a9-4c02-b388-5be4f0d5bb1c of volume 0ecf6fa6-99de-4d8e-a303-542312657674 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:03:20 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-9cc184d6-317d-460e-90ea-3e7434537299 tempest-ProjectMemberTests-351068705 None] snapshot_file for this snap is: volume-0ecf6fa6-99de-4d8e-a303-542312657674.e19d63f5-88a9-4c02-b388-5be4f0d5bb1c {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:03:20 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[1948800b-d4f0-4319-ae58-a1e90b9ac1fa]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:03:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9cc184d6-317d-460e-90ea-3e7434537299 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674.e19d63f5-88a9-4c02-b388-5be4f0d5bb1c {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:20 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88 Sep 10 20:03:20 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:20 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674.e19d63f5-88a9-4c02-b388-5be4f0d5bb1c Sep 10 20:03:20 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:20 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88" returned: 0 in 0.310s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:20 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:03:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:20 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1177ca16-9370-4ba7-baf7-57de80597e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:20 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6c46c9d-3512-40ba-a8e5-a23b4c72b245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:20 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] Volume volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88 (9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88): created successfully Sep 10 20:03:20 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6c46c9d-3512-40ba-a8e5-a23b4c72b245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:20 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] Flow 'volume_create_manager' (3fba03e3-360d-4fdd-bd80-b8a02321c847) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:03:20 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-a57d65b1-d61a-4bc7-93d1-018c77b6454c tempest-SnapshotDependencyTests-979351265 None] Created volume successfully. Sep 10 20:03:20 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9cc184d6-317d-460e-90ea-3e7434537299 tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674.e19d63f5-88a9-4c02-b388-5be4f0d5bb1c" returned: 0 in 0.480s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:20 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-9cc184d6-317d-460e-90ea-3e7434537299 tempest-ProjectMemberTests-351068705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ecf6fa6-99de-4d8e-a303-542312657674(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:03:20 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d2b0e1-e4ae-4b87-9c81-8d9d0a1f09e4]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:03:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9cc184d6-317d-460e-90ea-3e7434537299 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:20 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674 Sep 10 20:03:20 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:21 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9cc184d6-317d-460e-90ea-3e7434537299 tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674" returned: 0 in 0.487s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9cc184d6-317d-460e-90ea-3e7434537299 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674.e19d63f5-88a9-4c02-b388-5be4f0d5bb1c {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:21 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674.e19d63f5-88a9-4c02-b388-5be4f0d5bb1c Sep 10 20:03:21 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e6420404-5bb7-4b5e-97c4-e4ecb98ca023 tempest-SnapshotDependencyTests-979351265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e6420404-5bb7-4b5e-97c4-e4ecb98ca023 tempest-SnapshotDependencyTests-979351265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:21 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-e6420404-5bb7-4b5e-97c4-e4ecb98ca023 tempest-SnapshotDependencyTests-979351265 None] Creating offline snapshot 3de12387-af77-4d94-8f5c-e2f4bbb1f356 of volume 9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:03:21 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[915bf19a-797f-489a-9436-6d49a454ed12]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:03:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e6420404-5bb7-4b5e-97c4-e4ecb98ca023 tempest-SnapshotDependencyTests-979351265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:21 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88 Sep 10 20:03:21 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:21 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9cc184d6-317d-460e-90ea-3e7434537299 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674.e19d63f5-88a9-4c02-b388-5be4f0d5bb1c" returned: 0 in 0.428s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9cc184d6-317d-460e-90ea-3e7434537299 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674.e19d63f5-88a9-4c02-b388-5be4f0d5bb1c {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:21 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674.e19d63f5-88a9-4c02-b388-5be4f0d5bb1c Sep 10 20:03:21 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:21 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e6420404-5bb7-4b5e-97c4-e4ecb98ca023 tempest-SnapshotDependencyTests-979351265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88" returned: 0 in 0.471s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e6420404-5bb7-4b5e-97c4-e4ecb98ca023 tempest-SnapshotDependencyTests-979351265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88.3de12387-af77-4d94-8f5c-e2f4bbb1f356 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:21 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88.3de12387-af77-4d94-8f5c-e2f4bbb1f356 1G Sep 10 20:03:21 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:21 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9cc184d6-317d-460e-90ea-3e7434537299 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674.e19d63f5-88a9-4c02-b388-5be4f0d5bb1c" returned: 0 in 0.312s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:21 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9cc184d6-317d-460e-90ea-3e7434537299 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-e19d63f5-88a9-4c02-b388-5be4f0d5bb1c" released by "_delete_snapshot" :: held 1.856s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:21 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9cc184d6-317d-460e-90ea-3e7434537299 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-0ecf6fa6-99de-4d8e-a303-542312657674" released by "delete_snapshot" :: held 1.885s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:21 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-9cc184d6-317d-460e-90ea-3e7434537299 tempest-ProjectMemberTests-351068705 None] Created reservations ['71f86691-5ee0-47be-9d75-020a91e559e1', '4bd77bbf-692c-4ff7-956f-566141bbd61a', 'f477c27c-e485-4534-a54c-c5f2ace80845', '93f4a594-1cb3-46cd-8283-65f964446e93'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:03:22 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-9cc184d6-317d-460e-90ea-3e7434537299 tempest-ProjectMemberTests-351068705 None] Delete snapshot completed successfully. Sep 10 20:03:22 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9cc184d6-317d-460e-90ea-3e7434537299 tempest-ProjectMemberTests-351068705 None] Lock "cinder-e19d63f5-88a9-4c02-b388-5be4f0d5bb1c-delete_snapshot" released by "delete_snapshot" :: held 2.087s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:22 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-015ed25d-ebe6-4d6d-ba5a-84551259c610 tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-0ecf6fa6-99de-4d8e-a303-542312657674-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:22 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e6420404-5bb7-4b5e-97c4-e4ecb98ca023 tempest-SnapshotDependencyTests-979351265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88.3de12387-af77-4d94-8f5c-e2f4bbb1f356 1G" returned: 0 in 0.593s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e6420404-5bb7-4b5e-97c4-e4ecb98ca023 tempest-SnapshotDependencyTests-979351265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88.3de12387-af77-4d94-8f5c-e2f4bbb1f356 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:22 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-015ed25d-ebe6-4d6d-ba5a-84551259c610 tempest-ProjectMemberTests-351068705 None] Lock "cinder-0ecf6fa6-99de-4d8e-a303-542312657674-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:22 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88.3de12387-af77-4d94-8f5c-e2f4bbb1f356 Sep 10 20:03:22 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:22 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-015ed25d-ebe6-4d6d-ba5a-84551259c610 tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-quobyte-0ecf6fa6-99de-4d8e-a303-542312657674" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:22 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-015ed25d-ebe6-4d6d-ba5a-84551259c610 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-0ecf6fa6-99de-4d8e-a303-542312657674" acquired by "delete_volume" :: waited 0.025s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:22 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa014681-a12f-4670-bc2b-930f99417115]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:03:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-015ed25d-ebe6-4d6d-ba5a-84551259c610 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:22 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674 Sep 10 20:03:22 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:22 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e6420404-5bb7-4b5e-97c4-e4ecb98ca023 tempest-SnapshotDependencyTests-979351265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88.3de12387-af77-4d94-8f5c-e2f4bbb1f356" returned: 0 in 0.462s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:22 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-e6420404-5bb7-4b5e-97c4-e4ecb98ca023 tempest-SnapshotDependencyTests-979351265 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88.3de12387-af77-4d94-8f5c-e2f4bbb1f356 is being set with open permissions: ugo+rw Sep 10 20:03:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e6420404-5bb7-4b5e-97c4-e4ecb98ca023 tempest-SnapshotDependencyTests-979351265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88.3de12387-af77-4d94-8f5c-e2f4bbb1f356 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:22 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88.3de12387-af77-4d94-8f5c-e2f4bbb1f356 Sep 10 20:03:22 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:22 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-015ed25d-ebe6-4d6d-ba5a-84551259c610 tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674" returned: 0 in 0.581s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-015ed25d-ebe6-4d6d-ba5a-84551259c610 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:23 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674 Sep 10 20:03:23 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:23 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e6420404-5bb7-4b5e-97c4-e4ecb98ca023 tempest-SnapshotDependencyTests-979351265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88.3de12387-af77-4d94-8f5c-e2f4bbb1f356" returned: 0 in 0.344s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e6420404-5bb7-4b5e-97c4-e4ecb98ca023 tempest-SnapshotDependencyTests-979351265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:23 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88.info Sep 10 20:03:23 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:23 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-015ed25d-ebe6-4d6d-ba5a-84551259c610 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-0ecf6fa6-99de-4d8e-a303-542312657674" returned: 0 in 0.352s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:23 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-015ed25d-ebe6-4d6d-ba5a-84551259c610 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-0ecf6fa6-99de-4d8e-a303-542312657674" released by "delete_volume" :: held 1.027s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:23 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e6420404-5bb7-4b5e-97c4-e4ecb98ca023 tempest-SnapshotDependencyTests-979351265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88.info" returned: 0 in 0.348s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:23 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-e6420404-5bb7-4b5e-97c4-e4ecb98ca023 tempest-SnapshotDependencyTests-979351265 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88.info is being set with open permissions: ugo+rw Sep 10 20:03:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e6420404-5bb7-4b5e-97c4-e4ecb98ca023 tempest-SnapshotDependencyTests-979351265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:23 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-015ed25d-ebe6-4d6d-ba5a-84551259c610 tempest-ProjectMemberTests-351068705 None] Created reservations ['c4dede67-8942-4a24-a960-e8dcfcb51a83', 'db738b0f-5597-41dd-bade-beced1eff152', '2bbad003-765a-4804-bed1-db0297d1f8c9', 'eb85ef88-96ab-4aed-939e-8444562cb0a1'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:03:23 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88.info Sep 10 20:03:23 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-015ed25d-ebe6-4d6d-ba5a-84551259c610 tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-015ed25d-ebe6-4d6d-ba5a-84551259c610 tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:23 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-015ed25d-ebe6-4d6d-ba5a-84551259c610 tempest-ProjectMemberTests-351068705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:03:23 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-015ed25d-ebe6-4d6d-ba5a-84551259c610 tempest-ProjectMemberTests-351068705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:03:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-015ed25d-ebe6-4d6d-ba5a-84551259c610 tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-015ed25d-ebe6-4d6d-ba5a-84551259c610 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:23 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:03:23 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:23 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e6420404-5bb7-4b5e-97c4-e4ecb98ca023 tempest-SnapshotDependencyTests-979351265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88.info" returned: 0 in 0.330s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e6420404-5bb7-4b5e-97c4-e4ecb98ca023 tempest-SnapshotDependencyTests-979351265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.686s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:23 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-e6420404-5bb7-4b5e-97c4-e4ecb98ca023 tempest-SnapshotDependencyTests-979351265 None] Create snapshot completed successfully Sep 10 20:03:23 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-015ed25d-ebe6-4d6d-ba5a-84551259c610 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.314s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:23 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-015ed25d-ebe6-4d6d-ba5a-84551259c610 tempest-ProjectMemberTests-351068705 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:03:23 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-015ed25d-ebe6-4d6d-ba5a-84551259c610 tempest-ProjectMemberTests-351068705 None] Deleted volume successfully. Sep 10 20:03:23 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-015ed25d-ebe6-4d6d-ba5a-84551259c610 tempest-ProjectMemberTests-351068705 None] Lock "cinder-0ecf6fa6-99de-4d8e-a303-542312657674-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Flow 'volume_create_manager' (6532952b-a8e1-419b-9b87-d2a3f02897aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a64bc9-a0f0-4ba1-ba9b-5263eccd3fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] Flow 'volume_create_manager' (ba95e470-f484-4215-b0bc-b530e37ee2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25688536-fbd3-435b-ade3-2a883f45047c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a64bc9-a0f0-4ba1-ba9b-5263eccd3fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=401f0499-7aa7-4d89-b119-ae758c2cffb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca4eeff7ff0348fe97598dd4711fb8fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3de12387-af77-4d94-8f5c-e2f4bbb1f356,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:03:25Z,use_quota=True,user_id='d803e5bbb12042d4a11e6ca174e28a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a09cb0b-17dd-47bb-abc1-d9d41ec75048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a09cb0b-17dd-47bb-abc1-d9d41ec75048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd99a5a-29c8-43fb-8911-be0d4ee689f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd99a5a-29c8-43fb-8911-be0d4ee689f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '401f0499-7aa7-4d89-b119-ae758c2cffb4', 'volume_name': 'volume-401f0499-7aa7-4d89-b119-ae758c2cffb4', 'volume_size': 1, 'snapshot_id': '3de12387-af77-4d94-8f5c-e2f4bbb1f356'}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e5aa7e-e5b8-44d0-9cf3-4682a4901f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e5aa7e-e5b8-44d0-9cf3-4682a4901f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0da453d-e0ef-48c1-80f5-5a79d72bc2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:25 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Volume 401f0499-7aa7-4d89-b119-ae758c2cffb4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-401f0499-7aa7-4d89-b119-ae758c2cffb4', 'volume_size': 1, 'snapshot_id': '3de12387-af77-4d94-8f5c-e2f4bbb1f356'} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Acquiring lock "cinder-quobyte-3de12387-af77-4d94-8f5c-e2f4bbb1f356-401f0499-7aa7-4d89-b119-ae758c2cffb4" by "_create_volume_from_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25688536-fbd3-435b-ade3-2a883f45047c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-506228796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4432ea2-bae0-4cf6-b2cf-48b6b691deec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e934bfdc8641078f63f0e9d068a844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:03:25Z,use_quota=True,user_id='fb77e81596394eb99432bed57c5670e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59de664f-2f71-4709-93b2-7370ca5984d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59de664f-2f71-4709-93b2-7370ca5984d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94798acb-9808-41f3-89ba-0927e63dbdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94798acb-9808-41f3-89ba-0927e63dbdf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4432ea2-bae0-4cf6-b2cf-48b6b691deec', 'volume_name': 'volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d638db67-a867-4a6d-ad64-e60e3be6b457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d638db67-a867-4a6d-ad64-e60e3be6b457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06958084-bbca-47e1-993a-00fe0daf3295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:25 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] Volume e4432ea2-bae0-4cf6-b2cf-48b6b691deec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec', 'volume_size': 1} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Lock "cinder-quobyte-3de12387-af77-4d94-8f5c-e2f4bbb1f356-401f0499-7aa7-4d89-b119-ae758c2cffb4" acquired by "_create_volume_from_snapshot" :: waited 0.071s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Creating volume 401f0499-7aa7-4d89-b119-ae758c2cffb4 from snapshot 3de12387-af77-4d94-8f5c-e2f4bbb1f356 {{(pid=88093) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Acquiring lock "cinder-quobyte-401f0499-7aa7-4d89-b119-ae758c2cffb4" by "_copy_volume_from_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Lock "cinder-quobyte-401f0499-7aa7-4d89-b119-ae758c2cffb4" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] snapshot: 3de12387-af77-4d94-8f5c-e2f4bbb1f356, volume: 401f0499-7aa7-4d89-b119-ae758c2cffb4, {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a260caf-0f7f-4237-a1e8-e7637644f80f]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:03:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88.3de12387-af77-4d94-8f5c-e2f4bbb1f356 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:25 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88.3de12387-af77-4d94-8f5c-e2f4bbb1f356 Sep 10 20:03:25 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:26 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88.3de12387-af77-4d94-8f5c-e2f4bbb1f356" returned: 0 in 0.480s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:26 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:03:26 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[a128775b-9ccc-48b9-ac16-bb54684f2d13]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:03:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:26 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88 Sep 10 20:03:26 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:26 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88" returned: 0 in 0.392s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:26 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88 {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 20:03:26 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Creating direct copy from snapshot {{(pid=88093) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 20:03:26 devstack cinder-volume[88093]: DEBUG cinder.utils [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Path /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-401f0499-7aa7-4d89-b119-ae758c2cffb4 not found in is_blk_device check {{(pid=88093) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 20:03:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-401f0499-7aa7-4d89-b119-ae758c2cffb4 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:26 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-401f0499-7aa7-4d89-b119-ae758c2cffb4 Sep 10 20:03:26 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:30 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-401f0499-7aa7-4d89-b119-ae758c2cffb4" returned: 0 in 4.190s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:30 devstack cinder-volume[88093]: DEBUG cinder.image.image_utils [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Image conversion details: src /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88, size 1024.00 MB, duration 4.19 sec, destination /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-401f0499-7aa7-4d89-b119-ae758c2cffb4 {{(pid=88093) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 20:03:30 devstack cinder-volume[88093]: INFO cinder.image.image_utils [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Converted 1024.00 MB image at 244.35 MB/s Sep 10 20:03:30 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-401f0499-7aa7-4d89-b119-ae758c2cffb4 is being set with open permissions: ugo+rw Sep 10 20:03:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-401f0499-7aa7-4d89-b119-ae758c2cffb4 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:30 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-401f0499-7aa7-4d89-b119-ae758c2cffb4 Sep 10 20:03:30 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:31 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-401f0499-7aa7-4d89-b119-ae758c2cffb4" returned: 0 in 0.247s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Lock "cinder-quobyte-401f0499-7aa7-4d89-b119-ae758c2cffb4" released by "_copy_volume_from_snapshot" :: held 5.407s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Lock "cinder-quobyte-3de12387-af77-4d94-8f5c-e2f4bbb1f356-401f0499-7aa7-4d89-b119-ae758c2cffb4" released by "_create_volume_from_snapshot" :: held 5.479s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.551s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.498s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-506228796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4432ea2-bae0-4cf6-b2cf-48b6b691deec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e934bfdc8641078f63f0e9d068a844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:03:25Z,use_quota=True,user_id='fb77e81596394eb99432bed57c5670e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] Creating volume e4432ea2-bae0-4cf6-b2cf-48b6b691deec {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:03:31 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:31 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec 1073741824 Sep 10 20:03:31 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0da453d-e0ef-48c1-80f5-5a79d72bc2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-401f0499-7aa7-4d89-b119-ae758c2cffb4', 'volume_size': 1, 'snapshot_id': '3de12387-af77-4d94-8f5c-e2f4bbb1f356'}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc11287-276e-4aba-8f72-1aa7eca9b339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:31 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Volume volume-401f0499-7aa7-4d89-b119-ae758c2cffb4 (401f0499-7aa7-4d89-b119-ae758c2cffb4): created successfully Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc11287-276e-4aba-8f72-1aa7eca9b339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Flow 'volume_create_manager' (6532952b-a8e1-419b-9b87-d2a3f02897aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:03:31 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-2025f969-01cd-4ab4-ad73-9ceda2ac0cb4 tempest-SnapshotDependencyTests-979351265 None] Created volume successfully. Sep 10 20:03:31 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec 1073741824" returned: 0 in 0.488s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-297b25d9-2f35-4816-bf4e-8c7ec3524708 tempest-SnapshotDependencyTests-979351265 None] Acquiring lock "cinder-3de12387-af77-4d94-8f5c-e2f4bbb1f356-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:31 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec Sep 10 20:03:31 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-297b25d9-2f35-4816-bf4e-8c7ec3524708 tempest-SnapshotDependencyTests-979351265 None] Lock "cinder-3de12387-af77-4d94-8f5c-e2f4bbb1f356-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-297b25d9-2f35-4816-bf4e-8c7ec3524708 tempest-SnapshotDependencyTests-979351265 None] Acquiring lock "cinder-quobyte-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-297b25d9-2f35-4816-bf4e-8c7ec3524708 tempest-SnapshotDependencyTests-979351265 None] Lock "cinder-quobyte-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-297b25d9-2f35-4816-bf4e-8c7ec3524708 tempest-SnapshotDependencyTests-979351265 None] Acquiring lock "cinder-quobyte-3de12387-af77-4d94-8f5c-e2f4bbb1f356" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-297b25d9-2f35-4816-bf4e-8c7ec3524708 tempest-SnapshotDependencyTests-979351265 None] Lock "cinder-quobyte-3de12387-af77-4d94-8f5c-e2f4bbb1f356" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-297b25d9-2f35-4816-bf4e-8c7ec3524708 tempest-SnapshotDependencyTests-979351265 None] Deleting offline snapshot 3de12387-af77-4d94-8f5c-e2f4bbb1f356 of volume 9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-297b25d9-2f35-4816-bf4e-8c7ec3524708 tempest-SnapshotDependencyTests-979351265 None] snapshot_file for this snap is: volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88.3de12387-af77-4d94-8f5c-e2f4bbb1f356 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fb1203-94e4-46f4-b0db-3c87799f3a4a]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-297b25d9-2f35-4816-bf4e-8c7ec3524708 tempest-SnapshotDependencyTests-979351265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88.3de12387-af77-4d94-8f5c-e2f4bbb1f356 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:31 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88.3de12387-af77-4d94-8f5c-e2f4bbb1f356 Sep 10 20:03:31 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:31 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec" returned: 0 in 0.245s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06958084-bbca-47e1-993a-00fe0daf3295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0586106f-44dc-4de3-8cb2-2ecb1077a588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:31 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] Volume volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec (e4432ea2-bae0-4cf6-b2cf-48b6b691deec): created successfully Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0586106f-44dc-4de3-8cb2-2ecb1077a588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:31 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] Flow 'volume_create_manager' (ba95e470-f484-4215-b0bc-b530e37ee2a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:03:31 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-b656c50b-2df0-446d-bd4a-db5798da0eb1 tempest-ProjectMemberTests-351068705 None] Created volume successfully. Sep 10 20:03:32 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-297b25d9-2f35-4816-bf4e-8c7ec3524708 tempest-SnapshotDependencyTests-979351265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88.3de12387-af77-4d94-8f5c-e2f4bbb1f356" returned: 0 in 0.407s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:32 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-297b25d9-2f35-4816-bf4e-8c7ec3524708 tempest-SnapshotDependencyTests-979351265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:03:32 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[512eaae7-2ac5-4782-b763-e9d0377acdc8]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:03:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-297b25d9-2f35-4816-bf4e-8c7ec3524708 tempest-SnapshotDependencyTests-979351265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:32 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88 Sep 10 20:03:32 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:32 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-297b25d9-2f35-4816-bf4e-8c7ec3524708 tempest-SnapshotDependencyTests-979351265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88" returned: 0 in 0.573s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-297b25d9-2f35-4816-bf4e-8c7ec3524708 tempest-SnapshotDependencyTests-979351265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88.3de12387-af77-4d94-8f5c-e2f4bbb1f356 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:32 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88.3de12387-af77-4d94-8f5c-e2f4bbb1f356 Sep 10 20:03:32 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-fcf428ce-cc97-42fa-8990-45b2ef519ffc tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-fcf428ce-cc97-42fa-8990-45b2ef519ffc tempest-ProjectMemberTests-351068705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:32 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-fcf428ce-cc97-42fa-8990-45b2ef519ffc tempest-ProjectMemberTests-351068705 None] Creating offline snapshot 256ee219-85d8-49d3-a0b7-370c83a23c3b of volume e4432ea2-bae0-4cf6-b2cf-48b6b691deec {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:03:32 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[8178cb6e-f9a2-4b17-9262-8f44eee46486]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:03:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fcf428ce-cc97-42fa-8990-45b2ef519ffc tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:33 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec Sep 10 20:03:33 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:33 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-297b25d9-2f35-4816-bf4e-8c7ec3524708 tempest-SnapshotDependencyTests-979351265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88.3de12387-af77-4d94-8f5c-e2f4bbb1f356" returned: 0 in 0.360s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-297b25d9-2f35-4816-bf4e-8c7ec3524708 tempest-SnapshotDependencyTests-979351265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88.3de12387-af77-4d94-8f5c-e2f4bbb1f356 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:33 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88.3de12387-af77-4d94-8f5c-e2f4bbb1f356 Sep 10 20:03:33 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:33 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fcf428ce-cc97-42fa-8990-45b2ef519ffc tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec" returned: 0 in 0.380s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fcf428ce-cc97-42fa-8990-45b2ef519ffc tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec.256ee219-85d8-49d3-a0b7-370c83a23c3b 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:33 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec.256ee219-85d8-49d3-a0b7-370c83a23c3b 1G Sep 10 20:03:33 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:33 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-297b25d9-2f35-4816-bf4e-8c7ec3524708 tempest-SnapshotDependencyTests-979351265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88.3de12387-af77-4d94-8f5c-e2f4bbb1f356" returned: 0 in 0.294s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:33 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-297b25d9-2f35-4816-bf4e-8c7ec3524708 tempest-SnapshotDependencyTests-979351265 None] Lock "cinder-quobyte-3de12387-af77-4d94-8f5c-e2f4bbb1f356" released by "_delete_snapshot" :: held 1.738s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:33 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-297b25d9-2f35-4816-bf4e-8c7ec3524708 tempest-SnapshotDependencyTests-979351265 None] Lock "cinder-quobyte-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88" released by "delete_snapshot" :: held 1.765s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:33 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-297b25d9-2f35-4816-bf4e-8c7ec3524708 tempest-SnapshotDependencyTests-979351265 None] Created reservations ['02ef3d65-502c-42a0-94c5-feb382c91f71', '6c313234-7677-4304-9c00-5019c93599a9', '04b6d9ed-9324-4dc6-8799-32e0eaaf5d80', 'cfba7877-e48d-482a-b4d2-9a3e2f31c37c'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:03:33 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-297b25d9-2f35-4816-bf4e-8c7ec3524708 tempest-SnapshotDependencyTests-979351265 None] Delete snapshot completed successfully. Sep 10 20:03:33 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-297b25d9-2f35-4816-bf4e-8c7ec3524708 tempest-SnapshotDependencyTests-979351265 None] Lock "cinder-3de12387-af77-4d94-8f5c-e2f4bbb1f356-delete_snapshot" released by "delete_snapshot" :: held 1.922s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:33 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fcf428ce-cc97-42fa-8990-45b2ef519ffc tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec.256ee219-85d8-49d3-a0b7-370c83a23c3b 1G" returned: 0 in 0.449s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fcf428ce-cc97-42fa-8990-45b2ef519ffc tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec.256ee219-85d8-49d3-a0b7-370c83a23c3b {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:33 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec.256ee219-85d8-49d3-a0b7-370c83a23c3b Sep 10 20:03:33 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:33 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4941b2b8-c927-427c-86a6-b6a967817766 tempest-SnapshotDependencyTests-979351265 None] Acquiring lock "cinder-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:33 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4941b2b8-c927-427c-86a6-b6a967817766 tempest-SnapshotDependencyTests-979351265 None] Lock "cinder-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:33 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4941b2b8-c927-427c-86a6-b6a967817766 tempest-SnapshotDependencyTests-979351265 None] Acquiring lock "cinder-quobyte-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:34 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4941b2b8-c927-427c-86a6-b6a967817766 tempest-SnapshotDependencyTests-979351265 None] Lock "cinder-quobyte-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88" acquired by "delete_volume" :: waited 0.016s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:34 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[403502dd-764a-449a-a056-711275d536f6]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:03:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4941b2b8-c927-427c-86a6-b6a967817766 tempest-SnapshotDependencyTests-979351265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:34 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fcf428ce-cc97-42fa-8990-45b2ef519ffc tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec.256ee219-85d8-49d3-a0b7-370c83a23c3b" returned: 0 in 0.326s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:34 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-fcf428ce-cc97-42fa-8990-45b2ef519ffc tempest-ProjectMemberTests-351068705 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec.256ee219-85d8-49d3-a0b7-370c83a23c3b is being set with open permissions: ugo+rw Sep 10 20:03:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fcf428ce-cc97-42fa-8990-45b2ef519ffc tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec.256ee219-85d8-49d3-a0b7-370c83a23c3b {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:34 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec.256ee219-85d8-49d3-a0b7-370c83a23c3b Sep 10 20:03:34 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:34 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88 Sep 10 20:03:34 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:34 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fcf428ce-cc97-42fa-8990-45b2ef519ffc tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec.256ee219-85d8-49d3-a0b7-370c83a23c3b" returned: 0 in 0.280s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fcf428ce-cc97-42fa-8990-45b2ef519ffc tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:34 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec.info Sep 10 20:03:34 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:34 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4941b2b8-c927-427c-86a6-b6a967817766 tempest-SnapshotDependencyTests-979351265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88" returned: 0 in 0.411s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4941b2b8-c927-427c-86a6-b6a967817766 tempest-SnapshotDependencyTests-979351265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:34 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88 Sep 10 20:03:34 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:34 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:34 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fcf428ce-cc97-42fa-8990-45b2ef519ffc tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec.info" returned: 0 in 0.299s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:34 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-fcf428ce-cc97-42fa-8990-45b2ef519ffc tempest-ProjectMemberTests-351068705 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec.info is being set with open permissions: ugo+rw Sep 10 20:03:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fcf428ce-cc97-42fa-8990-45b2ef519ffc tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4941b2b8-c927-427c-86a6-b6a967817766 tempest-SnapshotDependencyTests-979351265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88" returned: 0 in 0.276s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:34 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec.info Sep 10 20:03:34 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:34 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4941b2b8-c927-427c-86a6-b6a967817766 tempest-SnapshotDependencyTests-979351265 None] Lock "cinder-quobyte-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88" released by "delete_volume" :: held 0.759s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:34 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-4941b2b8-c927-427c-86a6-b6a967817766 tempest-SnapshotDependencyTests-979351265 None] Created reservations ['b22d5668-e593-4fdc-b567-442e9b0c7b22', '7c12ff59-3cc8-4c60-9bd1-2cde4d0b6b00', '3a58ff43-c62b-465f-a702-7a391a4fe4a9', '68f24a2f-133d-4f2a-9b96-8b2faaf37b48'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:03:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-4941b2b8-c927-427c-86a6-b6a967817766 tempest-SnapshotDependencyTests-979351265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-4941b2b8-c927-427c-86a6-b6a967817766 tempest-SnapshotDependencyTests-979351265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:34 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-4941b2b8-c927-427c-86a6-b6a967817766 tempest-SnapshotDependencyTests-979351265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:03:34 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-4941b2b8-c927-427c-86a6-b6a967817766 tempest-SnapshotDependencyTests-979351265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:03:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-4941b2b8-c927-427c-86a6-b6a967817766 tempest-SnapshotDependencyTests-979351265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4941b2b8-c927-427c-86a6-b6a967817766 tempest-SnapshotDependencyTests-979351265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:34 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:03:34 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:35 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fcf428ce-cc97-42fa-8990-45b2ef519ffc tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec.info" returned: 0 in 0.291s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-fcf428ce-cc97-42fa-8990-45b2ef519ffc tempest-ProjectMemberTests-351068705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.120s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:35 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-fcf428ce-cc97-42fa-8990-45b2ef519ffc tempest-ProjectMemberTests-351068705 None] Create snapshot completed successfully Sep 10 20:03:35 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7a0f8a5a-e1a5-4748-b179-2ad4b269fcc4 tempest-SnapshotDependencyTests-979351265 None] Acquiring lock "cinder-401f0499-7aa7-4d89-b119-ae758c2cffb4-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:35 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7a0f8a5a-e1a5-4748-b179-2ad4b269fcc4 tempest-SnapshotDependencyTests-979351265 None] Lock "cinder-401f0499-7aa7-4d89-b119-ae758c2cffb4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:35 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7a0f8a5a-e1a5-4748-b179-2ad4b269fcc4 tempest-SnapshotDependencyTests-979351265 None] Acquiring lock "cinder-quobyte-401f0499-7aa7-4d89-b119-ae758c2cffb4" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:35 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7a0f8a5a-e1a5-4748-b179-2ad4b269fcc4 tempest-SnapshotDependencyTests-979351265 None] Lock "cinder-quobyte-401f0499-7aa7-4d89-b119-ae758c2cffb4" acquired by "delete_volume" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:35 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4941b2b8-c927-427c-86a6-b6a967817766 tempest-SnapshotDependencyTests-979351265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.305s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:35 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-4941b2b8-c927-427c-86a6-b6a967817766 tempest-SnapshotDependencyTests-979351265 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:03:35 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-4941b2b8-c927-427c-86a6-b6a967817766 tempest-SnapshotDependencyTests-979351265 None] Deleted volume successfully. Sep 10 20:03:35 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c26552a-61f5-4483-9d70-a529bd3fd30a]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:03:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7a0f8a5a-e1a5-4748-b179-2ad4b269fcc4 tempest-SnapshotDependencyTests-979351265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-401f0499-7aa7-4d89-b119-ae758c2cffb4 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:35 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4941b2b8-c927-427c-86a6-b6a967817766 tempest-SnapshotDependencyTests-979351265 None] Lock "cinder-9d9c1505-f20a-45b7-8e57-6b9ac3bf3e88-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:35 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-401f0499-7aa7-4d89-b119-ae758c2cffb4 Sep 10 20:03:35 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:35 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7a0f8a5a-e1a5-4748-b179-2ad4b269fcc4 tempest-SnapshotDependencyTests-979351265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-401f0499-7aa7-4d89-b119-ae758c2cffb4" returned: 0 in 0.373s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7a0f8a5a-e1a5-4748-b179-2ad4b269fcc4 tempest-SnapshotDependencyTests-979351265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-401f0499-7aa7-4d89-b119-ae758c2cffb4 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:35 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-401f0499-7aa7-4d89-b119-ae758c2cffb4 Sep 10 20:03:35 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:35 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7a0f8a5a-e1a5-4748-b179-2ad4b269fcc4 tempest-SnapshotDependencyTests-979351265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-401f0499-7aa7-4d89-b119-ae758c2cffb4" returned: 0 in 0.244s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:35 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7a0f8a5a-e1a5-4748-b179-2ad4b269fcc4 tempest-SnapshotDependencyTests-979351265 None] Lock "cinder-quobyte-401f0499-7aa7-4d89-b119-ae758c2cffb4" released by "delete_volume" :: held 0.665s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:35 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-7a0f8a5a-e1a5-4748-b179-2ad4b269fcc4 tempest-SnapshotDependencyTests-979351265 None] Created reservations ['4cdfe958-854f-43d0-8fc3-06852ccab5a5', '8cb2b2b4-c89e-4214-ab19-cdf3f5229852', 'dfe9e7a4-4900-4703-9129-184a46a14be6', '505f14a9-86e4-4fa1-b4af-87658e97c557'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:03:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7a0f8a5a-e1a5-4748-b179-2ad4b269fcc4 tempest-SnapshotDependencyTests-979351265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7a0f8a5a-e1a5-4748-b179-2ad4b269fcc4 tempest-SnapshotDependencyTests-979351265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:36 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7a0f8a5a-e1a5-4748-b179-2ad4b269fcc4 tempest-SnapshotDependencyTests-979351265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:03:36 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7a0f8a5a-e1a5-4748-b179-2ad4b269fcc4 tempest-SnapshotDependencyTests-979351265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:03:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7a0f8a5a-e1a5-4748-b179-2ad4b269fcc4 tempest-SnapshotDependencyTests-979351265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7a0f8a5a-e1a5-4748-b179-2ad4b269fcc4 tempest-SnapshotDependencyTests-979351265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:36 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:03:36 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:36 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2e63b15c-5368-4b80-8f4e-bd97b069675a tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-256ee219-85d8-49d3-a0b7-370c83a23c3b-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:36 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2e63b15c-5368-4b80-8f4e-bd97b069675a tempest-ProjectMemberTests-351068705 None] Lock "cinder-256ee219-85d8-49d3-a0b7-370c83a23c3b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:36 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2e63b15c-5368-4b80-8f4e-bd97b069675a tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-quobyte-e4432ea2-bae0-4cf6-b2cf-48b6b691deec" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:36 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2e63b15c-5368-4b80-8f4e-bd97b069675a tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-e4432ea2-bae0-4cf6-b2cf-48b6b691deec" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:36 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2e63b15c-5368-4b80-8f4e-bd97b069675a tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-quobyte-256ee219-85d8-49d3-a0b7-370c83a23c3b" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:36 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2e63b15c-5368-4b80-8f4e-bd97b069675a tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-256ee219-85d8-49d3-a0b7-370c83a23c3b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:36 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-2e63b15c-5368-4b80-8f4e-bd97b069675a tempest-ProjectMemberTests-351068705 None] Deleting offline snapshot 256ee219-85d8-49d3-a0b7-370c83a23c3b of volume e4432ea2-bae0-4cf6-b2cf-48b6b691deec {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:03:36 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-2e63b15c-5368-4b80-8f4e-bd97b069675a tempest-ProjectMemberTests-351068705 None] snapshot_file for this snap is: volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec.256ee219-85d8-49d3-a0b7-370c83a23c3b {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:03:36 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ce6939-03a9-40ff-8a5b-71a55b704dfc]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:03:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2e63b15c-5368-4b80-8f4e-bd97b069675a tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec.256ee219-85d8-49d3-a0b7-370c83a23c3b {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:36 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7a0f8a5a-e1a5-4748-b179-2ad4b269fcc4 tempest-SnapshotDependencyTests-979351265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.284s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:36 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-7a0f8a5a-e1a5-4748-b179-2ad4b269fcc4 tempest-SnapshotDependencyTests-979351265 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:03:36 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-7a0f8a5a-e1a5-4748-b179-2ad4b269fcc4 tempest-SnapshotDependencyTests-979351265 None] Deleted volume successfully. Sep 10 20:03:36 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec.256ee219-85d8-49d3-a0b7-370c83a23c3b Sep 10 20:03:36 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:36 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7a0f8a5a-e1a5-4748-b179-2ad4b269fcc4 tempest-SnapshotDependencyTests-979351265 None] Lock "cinder-401f0499-7aa7-4d89-b119-ae758c2cffb4-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:36 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2e63b15c-5368-4b80-8f4e-bd97b069675a tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec.256ee219-85d8-49d3-a0b7-370c83a23c3b" returned: 0 in 0.418s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:36 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-2e63b15c-5368-4b80-8f4e-bd97b069675a tempest-ProjectMemberTests-351068705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:03:36 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[22449020-5de8-4e52-b70c-06982cb48727]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:03:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2e63b15c-5368-4b80-8f4e-bd97b069675a tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:36 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec Sep 10 20:03:36 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:37 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2e63b15c-5368-4b80-8f4e-bd97b069675a tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec" returned: 0 in 0.425s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2e63b15c-5368-4b80-8f4e-bd97b069675a tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec.256ee219-85d8-49d3-a0b7-370c83a23c3b {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:37 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec.256ee219-85d8-49d3-a0b7-370c83a23c3b Sep 10 20:03:37 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:37 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2e63b15c-5368-4b80-8f4e-bd97b069675a tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec.256ee219-85d8-49d3-a0b7-370c83a23c3b" returned: 0 in 0.454s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2e63b15c-5368-4b80-8f4e-bd97b069675a tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec.256ee219-85d8-49d3-a0b7-370c83a23c3b {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:37 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec.256ee219-85d8-49d3-a0b7-370c83a23c3b Sep 10 20:03:37 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:37 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2e63b15c-5368-4b80-8f4e-bd97b069675a tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec.256ee219-85d8-49d3-a0b7-370c83a23c3b" returned: 0 in 0.282s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2e63b15c-5368-4b80-8f4e-bd97b069675a tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-256ee219-85d8-49d3-a0b7-370c83a23c3b" released by "_delete_snapshot" :: held 1.702s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2e63b15c-5368-4b80-8f4e-bd97b069675a tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-e4432ea2-bae0-4cf6-b2cf-48b6b691deec" released by "delete_snapshot" :: held 1.734s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:37 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-2e63b15c-5368-4b80-8f4e-bd97b069675a tempest-ProjectMemberTests-351068705 None] Created reservations ['1c432878-5438-4ea7-8cd8-03d1d29daf26', '258b2188-1f99-4192-b4d1-d2762aa1741e', '0003f8b4-0183-42dc-a4b8-c56d45e8f9bc', 'f0389f4f-d9fc-4615-8f98-a5ac666171b9'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:03:38 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-2e63b15c-5368-4b80-8f4e-bd97b069675a tempest-ProjectMemberTests-351068705 None] Delete snapshot completed successfully. Sep 10 20:03:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2e63b15c-5368-4b80-8f4e-bd97b069675a tempest-ProjectMemberTests-351068705 None] Lock "cinder-256ee219-85d8-49d3-a0b7-370c83a23c3b-delete_snapshot" released by "delete_snapshot" :: held 1.908s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3d18f05a-8751-4017-9379-00146b0172f4 tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-e4432ea2-bae0-4cf6-b2cf-48b6b691deec-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3d18f05a-8751-4017-9379-00146b0172f4 tempest-ProjectMemberTests-351068705 None] Lock "cinder-e4432ea2-bae0-4cf6-b2cf-48b6b691deec-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3d18f05a-8751-4017-9379-00146b0172f4 tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-quobyte-e4432ea2-bae0-4cf6-b2cf-48b6b691deec" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3d18f05a-8751-4017-9379-00146b0172f4 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-e4432ea2-bae0-4cf6-b2cf-48b6b691deec" acquired by "delete_volume" :: waited 0.014s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:38 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d45dca-1629-4933-bf20-6459d15d983c]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:03:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3d18f05a-8751-4017-9379-00146b0172f4 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:38 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec Sep 10 20:03:38 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:38 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3d18f05a-8751-4017-9379-00146b0172f4 tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec" returned: 0 in 0.394s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3d18f05a-8751-4017-9379-00146b0172f4 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:38 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec Sep 10 20:03:38 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:39 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3d18f05a-8751-4017-9379-00146b0172f4 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e4432ea2-bae0-4cf6-b2cf-48b6b691deec" returned: 0 in 0.273s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:39 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3d18f05a-8751-4017-9379-00146b0172f4 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-e4432ea2-bae0-4cf6-b2cf-48b6b691deec" released by "delete_volume" :: held 0.738s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:39 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-3d18f05a-8751-4017-9379-00146b0172f4 tempest-ProjectMemberTests-351068705 None] Created reservations ['570147c1-8a7e-4885-b34f-9b68def3f35d', '71f49920-bacb-46c7-8563-c1a77ce7c4fe', 'a0636cb9-4982-47f2-9e1b-3402c8dfee40', 'fddb97a5-fb35-4d1e-8d29-827fc9b16d7c'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:03:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3d18f05a-8751-4017-9379-00146b0172f4 tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3d18f05a-8751-4017-9379-00146b0172f4 tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:39 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3d18f05a-8751-4017-9379-00146b0172f4 tempest-ProjectMemberTests-351068705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:03:39 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3d18f05a-8751-4017-9379-00146b0172f4 tempest-ProjectMemberTests-351068705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:03:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3d18f05a-8751-4017-9379-00146b0172f4 tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3d18f05a-8751-4017-9379-00146b0172f4 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:39 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:03:39 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:39 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3d18f05a-8751-4017-9379-00146b0172f4 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.295s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:39 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-3d18f05a-8751-4017-9379-00146b0172f4 tempest-ProjectMemberTests-351068705 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:03:39 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-3d18f05a-8751-4017-9379-00146b0172f4 tempest-ProjectMemberTests-351068705 None] Deleted volume successfully. Sep 10 20:03:39 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3d18f05a-8751-4017-9379-00146b0172f4 tempest-ProjectMemberTests-351068705 None] Lock "cinder-e4432ea2-bae0-4cf6-b2cf-48b6b691deec-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:40 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:03:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] Flow 'volume_create_manager' (948a6c5f-6fa9-4893-9771-97999ec5a495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:03:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97380888-812c-4c3e-b21f-e467c8aae1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97380888-812c-4c3e-b21f-e467c8aae1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-387544733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e86edc43-565b-495e-931c-294d58ee90d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e934bfdc8641078f63f0e9d068a844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:03:40Z,use_quota=True,user_id='fb77e81596394eb99432bed57c5670e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d057732-393a-422e-926b-29a9ec7729de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d057732-393a-422e-926b-29a9ec7729de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efee78de-d110-4f94-a557-5025de5d6bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efee78de-d110-4f94-a557-5025de5d6bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e86edc43-565b-495e-931c-294d58ee90d2', 'volume_name': 'volume-e86edc43-565b-495e-931c-294d58ee90d2', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cfed3a5-b906-44de-a0e5-ae4b27f445e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cfed3a5-b906-44de-a0e5-ae4b27f445e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f7ae7f1-8712-4102-bef2-94699ef20082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:40 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] Volume e86edc43-565b-495e-931c-294d58ee90d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e86edc43-565b-495e-931c-294d58ee90d2', 'volume_size': 1} Sep 10 20:03:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-387544733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e86edc43-565b-495e-931c-294d58ee90d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e934bfdc8641078f63f0e9d068a844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:03:40Z,use_quota=True,user_id='fb77e81596394eb99432bed57c5670e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:03:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] Creating volume e86edc43-565b-495e-931c-294d58ee90d2 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:03:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:03:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:03:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:03:40 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:03:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:40 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2 1073741824 Sep 10 20:03:40 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:40 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2 1073741824" returned: 0 in 0.539s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:40 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2 Sep 10 20:03:40 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:41 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2" returned: 0 in 0.290s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:41 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:03:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f7ae7f1-8712-4102-bef2-94699ef20082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e86edc43-565b-495e-931c-294d58ee90d2', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67efd698-7f3c-45c9-bd8f-ef3c2a71d655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:41 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] Volume volume-e86edc43-565b-495e-931c-294d58ee90d2 (e86edc43-565b-495e-931c-294d58ee90d2): created successfully Sep 10 20:03:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67efd698-7f3c-45c9-bd8f-ef3c2a71d655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:41 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] Flow 'volume_create_manager' (948a6c5f-6fa9-4893-9771-97999ec5a495) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:03:41 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-26769472-67e2-4ab6-8e80-c352c6961436 tempest-ProjectMemberTests-351068705 None] Created volume successfully. Sep 10 20:03:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-52cb3d8e-0d54-4957-abe1-66bffad1a7e4 tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-52cb3d8e-0d54-4957-abe1-66bffad1a7e4 tempest-ProjectMemberTests-351068705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:42 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-52cb3d8e-0d54-4957-abe1-66bffad1a7e4 tempest-ProjectMemberTests-351068705 None] Creating offline snapshot 71ddb9e9-a556-49ec-989e-93acaeb31489 of volume e86edc43-565b-495e-931c-294d58ee90d2 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:03:42 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afe2fa4-b4c5-41a5-95f6-f7a59a16ed68]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:03:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-52cb3d8e-0d54-4957-abe1-66bffad1a7e4 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:42 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2 Sep 10 20:03:42 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:42 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-52cb3d8e-0d54-4957-abe1-66bffad1a7e4 tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2" returned: 0 in 0.419s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-52cb3d8e-0d54-4957-abe1-66bffad1a7e4 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2.71ddb9e9-a556-49ec-989e-93acaeb31489 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:42 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2.71ddb9e9-a556-49ec-989e-93acaeb31489 1G Sep 10 20:03:42 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:43 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-52cb3d8e-0d54-4957-abe1-66bffad1a7e4 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2.71ddb9e9-a556-49ec-989e-93acaeb31489 1G" returned: 0 in 0.485s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-52cb3d8e-0d54-4957-abe1-66bffad1a7e4 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e86edc43-565b-495e-931c-294d58ee90d2 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2.71ddb9e9-a556-49ec-989e-93acaeb31489 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:43 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e86edc43-565b-495e-931c-294d58ee90d2 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2.71ddb9e9-a556-49ec-989e-93acaeb31489 Sep 10 20:03:43 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:43 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-52cb3d8e-0d54-4957-abe1-66bffad1a7e4 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e86edc43-565b-495e-931c-294d58ee90d2 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2.71ddb9e9-a556-49ec-989e-93acaeb31489" returned: 0 in 0.310s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:43 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-52cb3d8e-0d54-4957-abe1-66bffad1a7e4 tempest-ProjectMemberTests-351068705 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2.71ddb9e9-a556-49ec-989e-93acaeb31489 is being set with open permissions: ugo+rw Sep 10 20:03:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-52cb3d8e-0d54-4957-abe1-66bffad1a7e4 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2.71ddb9e9-a556-49ec-989e-93acaeb31489 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:43 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2.71ddb9e9-a556-49ec-989e-93acaeb31489 Sep 10 20:03:43 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:44 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-52cb3d8e-0d54-4957-abe1-66bffad1a7e4 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2.71ddb9e9-a556-49ec-989e-93acaeb31489" returned: 0 in 0.313s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-52cb3d8e-0d54-4957-abe1-66bffad1a7e4 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:44 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2.info Sep 10 20:03:44 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:44 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-52cb3d8e-0d54-4957-abe1-66bffad1a7e4 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2.info" returned: 0 in 0.305s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:44 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-52cb3d8e-0d54-4957-abe1-66bffad1a7e4 tempest-ProjectMemberTests-351068705 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2.info is being set with open permissions: ugo+rw Sep 10 20:03:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-52cb3d8e-0d54-4957-abe1-66bffad1a7e4 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:44 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2.info Sep 10 20:03:44 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:44 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-52cb3d8e-0d54-4957-abe1-66bffad1a7e4 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2.info" returned: 0 in 0.260s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-52cb3d8e-0d54-4957-abe1-66bffad1a7e4 tempest-ProjectMemberTests-351068705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.195s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:44 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-52cb3d8e-0d54-4957-abe1-66bffad1a7e4 tempest-ProjectMemberTests-351068705 None] Create snapshot completed successfully Sep 10 20:03:45 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d699207b-36f0-4234-bde2-ebfe1818efec tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-71ddb9e9-a556-49ec-989e-93acaeb31489-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:45 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d699207b-36f0-4234-bde2-ebfe1818efec tempest-ProjectMemberTests-351068705 None] Lock "cinder-71ddb9e9-a556-49ec-989e-93acaeb31489-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:45 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d699207b-36f0-4234-bde2-ebfe1818efec tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-quobyte-e86edc43-565b-495e-931c-294d58ee90d2" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:45 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d699207b-36f0-4234-bde2-ebfe1818efec tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-e86edc43-565b-495e-931c-294d58ee90d2" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:45 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d699207b-36f0-4234-bde2-ebfe1818efec tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-quobyte-71ddb9e9-a556-49ec-989e-93acaeb31489" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:45 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d699207b-36f0-4234-bde2-ebfe1818efec tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-71ddb9e9-a556-49ec-989e-93acaeb31489" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-d699207b-36f0-4234-bde2-ebfe1818efec tempest-ProjectMemberTests-351068705 None] Deleting offline snapshot 71ddb9e9-a556-49ec-989e-93acaeb31489 of volume e86edc43-565b-495e-931c-294d58ee90d2 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:03:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-d699207b-36f0-4234-bde2-ebfe1818efec tempest-ProjectMemberTests-351068705 None] snapshot_file for this snap is: volume-e86edc43-565b-495e-931c-294d58ee90d2.71ddb9e9-a556-49ec-989e-93acaeb31489 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:03:45 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded02f79-e902-4b53-9624-3330ae1feae6]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:03:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d699207b-36f0-4234-bde2-ebfe1818efec tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2.71ddb9e9-a556-49ec-989e-93acaeb31489 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:46 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2.71ddb9e9-a556-49ec-989e-93acaeb31489 Sep 10 20:03:46 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:46 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d699207b-36f0-4234-bde2-ebfe1818efec tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2.71ddb9e9-a556-49ec-989e-93acaeb31489" returned: 0 in 0.472s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:46 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-d699207b-36f0-4234-bde2-ebfe1818efec tempest-ProjectMemberTests-351068705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e86edc43-565b-495e-931c-294d58ee90d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:03:46 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c534baa-f973-4a2e-a330-30f1afc80c1e]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:03:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d699207b-36f0-4234-bde2-ebfe1818efec tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:46 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2 Sep 10 20:03:46 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:46 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d699207b-36f0-4234-bde2-ebfe1818efec tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2" returned: 0 in 0.412s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d699207b-36f0-4234-bde2-ebfe1818efec tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2.71ddb9e9-a556-49ec-989e-93acaeb31489 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:46 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2.71ddb9e9-a556-49ec-989e-93acaeb31489 Sep 10 20:03:46 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:47 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d699207b-36f0-4234-bde2-ebfe1818efec tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2.71ddb9e9-a556-49ec-989e-93acaeb31489" returned: 0 in 0.434s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d699207b-36f0-4234-bde2-ebfe1818efec tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2.71ddb9e9-a556-49ec-989e-93acaeb31489 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:47 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2.71ddb9e9-a556-49ec-989e-93acaeb31489 Sep 10 20:03:47 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:47 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-d699207b-36f0-4234-bde2-ebfe1818efec tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2.71ddb9e9-a556-49ec-989e-93acaeb31489" returned: 0 in 0.267s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:47 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d699207b-36f0-4234-bde2-ebfe1818efec tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-71ddb9e9-a556-49ec-989e-93acaeb31489" released by "_delete_snapshot" :: held 1.696s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:47 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d699207b-36f0-4234-bde2-ebfe1818efec tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-e86edc43-565b-495e-931c-294d58ee90d2" released by "delete_snapshot" :: held 1.723s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:47 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-d699207b-36f0-4234-bde2-ebfe1818efec tempest-ProjectMemberTests-351068705 None] Created reservations ['30d8933c-a731-424d-9974-7a1325c4b838', '10e9e4a3-52f6-4de9-8d29-de1480f2d9e1', '2704efcc-023c-4f83-9e3c-d96ae151aa59', '1a90a033-b1de-4501-9614-1f417878627d'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:03:47 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-d699207b-36f0-4234-bde2-ebfe1818efec tempest-ProjectMemberTests-351068705 None] Delete snapshot completed successfully. Sep 10 20:03:47 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-d699207b-36f0-4234-bde2-ebfe1818efec tempest-ProjectMemberTests-351068705 None] Lock "cinder-71ddb9e9-a556-49ec-989e-93acaeb31489-delete_snapshot" released by "delete_snapshot" :: held 1.878s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:48 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-80424a9e-1b60-4aed-a1b6-a9d07cb7277b tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-e86edc43-565b-495e-931c-294d58ee90d2-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:48 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-80424a9e-1b60-4aed-a1b6-a9d07cb7277b tempest-ProjectMemberTests-351068705 None] Lock "cinder-e86edc43-565b-495e-931c-294d58ee90d2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:48 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-80424a9e-1b60-4aed-a1b6-a9d07cb7277b tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-quobyte-e86edc43-565b-495e-931c-294d58ee90d2" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:48 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-80424a9e-1b60-4aed-a1b6-a9d07cb7277b tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-e86edc43-565b-495e-931c-294d58ee90d2" acquired by "delete_volume" :: waited 0.018s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:48 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef523e00-2494-4606-ac34-6ae020959408]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:03:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-80424a9e-1b60-4aed-a1b6-a9d07cb7277b tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:48 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2 Sep 10 20:03:48 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:48 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-80424a9e-1b60-4aed-a1b6-a9d07cb7277b tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2" returned: 0 in 0.423s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-80424a9e-1b60-4aed-a1b6-a9d07cb7277b tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:48 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2 Sep 10 20:03:48 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:48 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:48 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-80424a9e-1b60-4aed-a1b6-a9d07cb7277b tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-e86edc43-565b-495e-931c-294d58ee90d2" returned: 0 in 0.239s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:48 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-80424a9e-1b60-4aed-a1b6-a9d07cb7277b tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-e86edc43-565b-495e-931c-294d58ee90d2" released by "delete_volume" :: held 0.729s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:48 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-80424a9e-1b60-4aed-a1b6-a9d07cb7277b tempest-ProjectMemberTests-351068705 None] Created reservations ['c3c73086-de6d-4cd8-831a-771ede94e422', '8599fa1e-5077-4e90-98c0-62a00fe2179a', '936e2001-e005-476c-9dc5-d3e35a642388', '0e1b0df2-c0a3-4fa0-9520-b7130b7b18f3'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:03:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-80424a9e-1b60-4aed-a1b6-a9d07cb7277b tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-80424a9e-1b60-4aed-a1b6-a9d07cb7277b tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-80424a9e-1b60-4aed-a1b6-a9d07cb7277b tempest-ProjectMemberTests-351068705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:03:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-80424a9e-1b60-4aed-a1b6-a9d07cb7277b tempest-ProjectMemberTests-351068705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:03:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-80424a9e-1b60-4aed-a1b6-a9d07cb7277b tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-80424a9e-1b60-4aed-a1b6-a9d07cb7277b tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:49 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:03:49 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:49 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-80424a9e-1b60-4aed-a1b6-a9d07cb7277b tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.261s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:49 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-80424a9e-1b60-4aed-a1b6-a9d07cb7277b tempest-ProjectMemberTests-351068705 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:03:49 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-80424a9e-1b60-4aed-a1b6-a9d07cb7277b tempest-ProjectMemberTests-351068705 None] Deleted volume successfully. Sep 10 20:03:49 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-80424a9e-1b60-4aed-a1b6-a9d07cb7277b tempest-ProjectMemberTests-351068705 None] Lock "cinder-e86edc43-565b-495e-931c-294d58ee90d2-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:49 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:03:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] Flow 'volume_create_manager' (78684079-09c3-4e43-8a99-e959bb825bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:03:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (264722d2-5edd-4281-ab5c-daf7b8e162de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (264722d2-5edd-4281-ab5c-daf7b8e162de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1085151129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27808a01-f457-4594-bdfd-e0d2cc1a6739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e934bfdc8641078f63f0e9d068a844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:03:50Z,use_quota=True,user_id='fb77e81596394eb99432bed57c5670e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c679ab7-96d1-468b-98b7-fbd984766ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c679ab7-96d1-468b-98b7-fbd984766ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c568f418-bc1f-4f84-a713-48212a527289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c568f418-bc1f-4f84-a713-48212a527289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27808a01-f457-4594-bdfd-e0d2cc1a6739', 'volume_name': 'volume-27808a01-f457-4594-bdfd-e0d2cc1a6739', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85657ca5-1d92-4008-ba6e-1129ac078def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85657ca5-1d92-4008-ba6e-1129ac078def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:49 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e757a815-f8f6-494c-86f5-1dd6697b43a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:49 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] Volume 27808a01-f457-4594-bdfd-e0d2cc1a6739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27808a01-f457-4594-bdfd-e0d2cc1a6739', 'volume_size': 1} Sep 10 20:03:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1085151129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27808a01-f457-4594-bdfd-e0d2cc1a6739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e934bfdc8641078f63f0e9d068a844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:03:50Z,use_quota=True,user_id='fb77e81596394eb99432bed57c5670e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:03:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] Creating volume 27808a01-f457-4594-bdfd-e0d2cc1a6739 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:03:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:03:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:03:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:03:49 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:03:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:49 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739 1073741824 Sep 10 20:03:49 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:50 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739 1073741824" returned: 0 in 0.425s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:50 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739 Sep 10 20:03:50 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:50 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739" returned: 0 in 0.248s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:50 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:03:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:50 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e757a815-f8f6-494c-86f5-1dd6697b43a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27808a01-f457-4594-bdfd-e0d2cc1a6739', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:50 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (528f96ef-741f-48bc-980d-272c76b17ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:50 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] Volume volume-27808a01-f457-4594-bdfd-e0d2cc1a6739 (27808a01-f457-4594-bdfd-e0d2cc1a6739): created successfully Sep 10 20:03:50 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (528f96ef-741f-48bc-980d-272c76b17ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:50 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] Flow 'volume_create_manager' (78684079-09c3-4e43-8a99-e959bb825bdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:03:50 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-aa545023-3bce-4aa6-976b-4c7fcf2544b4 tempest-ProjectMemberTests-351068705 None] Created volume successfully. Sep 10 20:03:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-21622f5d-569f-44ab-8f95-61db770b8b09 tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-21622f5d-569f-44ab-8f95-61db770b8b09 tempest-ProjectMemberTests-351068705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:50 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-21622f5d-569f-44ab-8f95-61db770b8b09 tempest-ProjectMemberTests-351068705 None] Creating offline snapshot 646f6f97-5c57-42f7-9c64-38e96c6067b0 of volume 27808a01-f457-4594-bdfd-e0d2cc1a6739 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:03:50 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[3242b8f9-fa9b-46c9-8d05-c3d745855d90]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:03:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-21622f5d-569f-44ab-8f95-61db770b8b09 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:51 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739 Sep 10 20:03:51 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:51 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-21622f5d-569f-44ab-8f95-61db770b8b09 tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739" returned: 0 in 0.373s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-21622f5d-569f-44ab-8f95-61db770b8b09 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739.646f6f97-5c57-42f7-9c64-38e96c6067b0 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:51 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739.646f6f97-5c57-42f7-9c64-38e96c6067b0 1G Sep 10 20:03:51 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:51 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-21622f5d-569f-44ab-8f95-61db770b8b09 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739.646f6f97-5c57-42f7-9c64-38e96c6067b0 1G" returned: 0 in 0.404s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-21622f5d-569f-44ab-8f95-61db770b8b09 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27808a01-f457-4594-bdfd-e0d2cc1a6739 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739.646f6f97-5c57-42f7-9c64-38e96c6067b0 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:51 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27808a01-f457-4594-bdfd-e0d2cc1a6739 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739.646f6f97-5c57-42f7-9c64-38e96c6067b0 Sep 10 20:03:51 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:52 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-21622f5d-569f-44ab-8f95-61db770b8b09 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27808a01-f457-4594-bdfd-e0d2cc1a6739 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739.646f6f97-5c57-42f7-9c64-38e96c6067b0" returned: 0 in 0.296s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:52 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-21622f5d-569f-44ab-8f95-61db770b8b09 tempest-ProjectMemberTests-351068705 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739.646f6f97-5c57-42f7-9c64-38e96c6067b0 is being set with open permissions: ugo+rw Sep 10 20:03:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-21622f5d-569f-44ab-8f95-61db770b8b09 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739.646f6f97-5c57-42f7-9c64-38e96c6067b0 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:52 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739.646f6f97-5c57-42f7-9c64-38e96c6067b0 Sep 10 20:03:52 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:52 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-21622f5d-569f-44ab-8f95-61db770b8b09 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739.646f6f97-5c57-42f7-9c64-38e96c6067b0" returned: 0 in 0.253s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-21622f5d-569f-44ab-8f95-61db770b8b09 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:52 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739.info Sep 10 20:03:52 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:52 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-21622f5d-569f-44ab-8f95-61db770b8b09 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739.info" returned: 0 in 0.260s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:52 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-21622f5d-569f-44ab-8f95-61db770b8b09 tempest-ProjectMemberTests-351068705 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739.info is being set with open permissions: ugo+rw Sep 10 20:03:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-21622f5d-569f-44ab-8f95-61db770b8b09 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:52 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739.info Sep 10 20:03:52 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:52 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-21622f5d-569f-44ab-8f95-61db770b8b09 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739.info" returned: 0 in 0.240s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-21622f5d-569f-44ab-8f95-61db770b8b09 tempest-ProjectMemberTests-351068705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.902s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:52 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-21622f5d-569f-44ab-8f95-61db770b8b09 tempest-ProjectMemberTests-351068705 None] Create snapshot completed successfully Sep 10 20:03:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-26ec8b80-27a2-4210-81fd-632eb823bce5 tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-646f6f97-5c57-42f7-9c64-38e96c6067b0-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-26ec8b80-27a2-4210-81fd-632eb823bce5 tempest-ProjectMemberTests-351068705 None] Lock "cinder-646f6f97-5c57-42f7-9c64-38e96c6067b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-26ec8b80-27a2-4210-81fd-632eb823bce5 tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-quobyte-27808a01-f457-4594-bdfd-e0d2cc1a6739" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-26ec8b80-27a2-4210-81fd-632eb823bce5 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-27808a01-f457-4594-bdfd-e0d2cc1a6739" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-26ec8b80-27a2-4210-81fd-632eb823bce5 tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-quobyte-646f6f97-5c57-42f7-9c64-38e96c6067b0" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-26ec8b80-27a2-4210-81fd-632eb823bce5 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-646f6f97-5c57-42f7-9c64-38e96c6067b0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:53 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-26ec8b80-27a2-4210-81fd-632eb823bce5 tempest-ProjectMemberTests-351068705 None] Deleting offline snapshot 646f6f97-5c57-42f7-9c64-38e96c6067b0 of volume 27808a01-f457-4594-bdfd-e0d2cc1a6739 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:03:53 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-26ec8b80-27a2-4210-81fd-632eb823bce5 tempest-ProjectMemberTests-351068705 None] snapshot_file for this snap is: volume-27808a01-f457-4594-bdfd-e0d2cc1a6739.646f6f97-5c57-42f7-9c64-38e96c6067b0 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:03:53 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a7684f-bb0f-4d4b-a570-5f65d3c722b1]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:03:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-26ec8b80-27a2-4210-81fd-632eb823bce5 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739.646f6f97-5c57-42f7-9c64-38e96c6067b0 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:53 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739.646f6f97-5c57-42f7-9c64-38e96c6067b0 Sep 10 20:03:53 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:53 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-26ec8b80-27a2-4210-81fd-632eb823bce5 tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739.646f6f97-5c57-42f7-9c64-38e96c6067b0" returned: 0 in 0.360s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:53 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-26ec8b80-27a2-4210-81fd-632eb823bce5 tempest-ProjectMemberTests-351068705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27808a01-f457-4594-bdfd-e0d2cc1a6739(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:03:53 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8fb36e-e4e4-4933-9813-826577658cd7]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:03:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-26ec8b80-27a2-4210-81fd-632eb823bce5 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:53 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739 Sep 10 20:03:53 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:53 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-26ec8b80-27a2-4210-81fd-632eb823bce5 tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739" returned: 0 in 0.349s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-26ec8b80-27a2-4210-81fd-632eb823bce5 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739.646f6f97-5c57-42f7-9c64-38e96c6067b0 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:53 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739.646f6f97-5c57-42f7-9c64-38e96c6067b0 Sep 10 20:03:53 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:54 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-26ec8b80-27a2-4210-81fd-632eb823bce5 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739.646f6f97-5c57-42f7-9c64-38e96c6067b0" returned: 0 in 0.331s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-26ec8b80-27a2-4210-81fd-632eb823bce5 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739.646f6f97-5c57-42f7-9c64-38e96c6067b0 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:54 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739.646f6f97-5c57-42f7-9c64-38e96c6067b0 Sep 10 20:03:54 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:54 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-26ec8b80-27a2-4210-81fd-632eb823bce5 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739.646f6f97-5c57-42f7-9c64-38e96c6067b0" returned: 0 in 0.241s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:54 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-26ec8b80-27a2-4210-81fd-632eb823bce5 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-646f6f97-5c57-42f7-9c64-38e96c6067b0" released by "_delete_snapshot" :: held 1.374s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:54 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-26ec8b80-27a2-4210-81fd-632eb823bce5 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-27808a01-f457-4594-bdfd-e0d2cc1a6739" released by "delete_snapshot" :: held 1.398s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:54 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-26ec8b80-27a2-4210-81fd-632eb823bce5 tempest-ProjectMemberTests-351068705 None] Created reservations ['153a8dc2-e72c-409a-929a-d5a540836202', 'b8f4681a-500a-4209-b9fe-595dcba55d64', '2dd52876-0779-4df0-8270-97547e9d2415', 'b6814258-28d1-45c4-890f-103dd4f7ab25'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:03:54 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-26ec8b80-27a2-4210-81fd-632eb823bce5 tempest-ProjectMemberTests-351068705 None] Delete snapshot completed successfully. Sep 10 20:03:54 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-26ec8b80-27a2-4210-81fd-632eb823bce5 tempest-ProjectMemberTests-351068705 None] Lock "cinder-646f6f97-5c57-42f7-9c64-38e96c6067b0-delete_snapshot" released by "delete_snapshot" :: held 1.544s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:55 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c60d8afa-3645-4e9a-8018-fa3f6adea3d9 tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-27808a01-f457-4594-bdfd-e0d2cc1a6739-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:55 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c60d8afa-3645-4e9a-8018-fa3f6adea3d9 tempest-ProjectMemberTests-351068705 None] Lock "cinder-27808a01-f457-4594-bdfd-e0d2cc1a6739-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:55 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c60d8afa-3645-4e9a-8018-fa3f6adea3d9 tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-quobyte-27808a01-f457-4594-bdfd-e0d2cc1a6739" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:03:55 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c60d8afa-3645-4e9a-8018-fa3f6adea3d9 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-27808a01-f457-4594-bdfd-e0d2cc1a6739" acquired by "delete_volume" :: waited 0.013s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:03:55 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4f08a4-ffe5-4e09-884a-f0cac83ce49c]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:03:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c60d8afa-3645-4e9a-8018-fa3f6adea3d9 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:55 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739 Sep 10 20:03:55 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:55 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c60d8afa-3645-4e9a-8018-fa3f6adea3d9 tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739" returned: 0 in 0.390s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c60d8afa-3645-4e9a-8018-fa3f6adea3d9 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:55 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739 Sep 10 20:03:55 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:55 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c60d8afa-3645-4e9a-8018-fa3f6adea3d9 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-27808a01-f457-4594-bdfd-e0d2cc1a6739" returned: 0 in 0.255s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c60d8afa-3645-4e9a-8018-fa3f6adea3d9 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-27808a01-f457-4594-bdfd-e0d2cc1a6739" released by "delete_volume" :: held 0.712s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-c60d8afa-3645-4e9a-8018-fa3f6adea3d9 tempest-ProjectMemberTests-351068705 None] Created reservations ['05c0f539-dd86-4255-9849-6f80686b9cce', '5b8d42c7-fa1b-47ba-935b-58e214a36567', 'e1f0e22c-6f79-401b-ab9c-9c3c3edace79', 'e4787943-9e5a-47c1-a687-948a96d667d3'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c60d8afa-3645-4e9a-8018-fa3f6adea3d9 tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c60d8afa-3645-4e9a-8018-fa3f6adea3d9 tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c60d8afa-3645-4e9a-8018-fa3f6adea3d9 tempest-ProjectMemberTests-351068705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c60d8afa-3645-4e9a-8018-fa3f6adea3d9 tempest-ProjectMemberTests-351068705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c60d8afa-3645-4e9a-8018-fa3f6adea3d9 tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c60d8afa-3645-4e9a-8018-fa3f6adea3d9 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:56 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:03:56 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:56 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c60d8afa-3645-4e9a-8018-fa3f6adea3d9 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.269s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-c60d8afa-3645-4e9a-8018-fa3f6adea3d9 tempest-ProjectMemberTests-351068705 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:03:56 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-c60d8afa-3645-4e9a-8018-fa3f6adea3d9 tempest-ProjectMemberTests-351068705 None] Deleted volume successfully. Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-c60d8afa-3645-4e9a-8018-fa3f6adea3d9 tempest-ProjectMemberTests-351068705 None] Lock "cinder-27808a01-f457-4594-bdfd-e0d2cc1a6739-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] Flow 'volume_create_manager' (9c107a65-f2d8-4fff-9d69-1c5b9cf96a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2f013bd-c717-468c-acef-f15aab7c3174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2f013bd-c717-468c-acef-f15aab7c3174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-321320955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88b9ae5c-046e-4a64-9d93-d51d2c64170d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e934bfdc8641078f63f0e9d068a844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:03:57Z,use_quota=True,user_id='fb77e81596394eb99432bed57c5670e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e368f90-d02b-4165-995c-a95f8a04997b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e368f90-d02b-4165-995c-a95f8a04997b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd1bb3b6-49f8-4344-a8de-fd69f4a7a3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd1bb3b6-49f8-4344-a8de-fd69f4a7a3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88b9ae5c-046e-4a64-9d93-d51d2c64170d', 'volume_name': 'volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5692224e-e98d-4a9d-8da5-57af41d78e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5692224e-e98d-4a9d-8da5-57af41d78e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97efa3fa-2161-42c7-86b3-b785eff00801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:56 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] Volume 88b9ae5c-046e-4a64-9d93-d51d2c64170d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d', 'volume_size': 1} Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-321320955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88b9ae5c-046e-4a64-9d93-d51d2c64170d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e934bfdc8641078f63f0e9d068a844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:03:57Z,use_quota=True,user_id='fb77e81596394eb99432bed57c5670e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] Creating volume 88b9ae5c-046e-4a64-9d93-d51d2c64170d {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:03:56 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:03:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:57 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d 1073741824 Sep 10 20:03:57 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:57 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d 1073741824" returned: 0 in 0.431s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:57 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d Sep 10 20:03:57 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:57 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d" returned: 0 in 0.266s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:57 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:03:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97efa3fa-2161-42c7-86b3-b785eff00801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1bcec8c-8df9-44b4-9d86-3558e6f9db12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:03:57 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] Volume volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d (88b9ae5c-046e-4a64-9d93-d51d2c64170d): created successfully Sep 10 20:03:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1bcec8c-8df9-44b4-9d86-3558e6f9db12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:03:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] Flow 'volume_create_manager' (9c107a65-f2d8-4fff-9d69-1c5b9cf96a49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:03:57 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-770fc813-3889-4c8a-b419-ccc06837062e tempest-ProjectMemberTests-351068705 None] Created volume successfully. Sep 10 20:03:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ad20d019-c4ef-4a0e-beec-4fe11be54d9e tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ad20d019-c4ef-4a0e-beec-4fe11be54d9e tempest-ProjectMemberTests-351068705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:58 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-ad20d019-c4ef-4a0e-beec-4fe11be54d9e tempest-ProjectMemberTests-351068705 None] Creating offline snapshot 81dacc7d-adae-4877-9c6c-4550707dd270 of volume 88b9ae5c-046e-4a64-9d93-d51d2c64170d {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:03:58 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[03053b73-7173-474e-8a01-5c294e4d663a]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:03:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad20d019-c4ef-4a0e-beec-4fe11be54d9e tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:58 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d Sep 10 20:03:58 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:58 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad20d019-c4ef-4a0e-beec-4fe11be54d9e tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d" returned: 0 in 0.383s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad20d019-c4ef-4a0e-beec-4fe11be54d9e tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d.81dacc7d-adae-4877-9c6c-4550707dd270 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:58 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d.81dacc7d-adae-4877-9c6c-4550707dd270 1G Sep 10 20:03:58 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:58 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad20d019-c4ef-4a0e-beec-4fe11be54d9e tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d.81dacc7d-adae-4877-9c6c-4550707dd270 1G" returned: 0 in 0.417s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad20d019-c4ef-4a0e-beec-4fe11be54d9e tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d.81dacc7d-adae-4877-9c6c-4550707dd270 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:58 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d.81dacc7d-adae-4877-9c6c-4550707dd270 Sep 10 20:03:58 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:59 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad20d019-c4ef-4a0e-beec-4fe11be54d9e tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d.81dacc7d-adae-4877-9c6c-4550707dd270" returned: 0 in 0.375s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:59 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-ad20d019-c4ef-4a0e-beec-4fe11be54d9e tempest-ProjectMemberTests-351068705 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d.81dacc7d-adae-4877-9c6c-4550707dd270 is being set with open permissions: ugo+rw Sep 10 20:03:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad20d019-c4ef-4a0e-beec-4fe11be54d9e tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d.81dacc7d-adae-4877-9c6c-4550707dd270 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:59 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d.81dacc7d-adae-4877-9c6c-4550707dd270 Sep 10 20:03:59 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:59 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad20d019-c4ef-4a0e-beec-4fe11be54d9e tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d.81dacc7d-adae-4877-9c6c-4550707dd270" returned: 0 in 0.277s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad20d019-c4ef-4a0e-beec-4fe11be54d9e tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:59 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d.info Sep 10 20:03:59 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:59 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad20d019-c4ef-4a0e-beec-4fe11be54d9e tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d.info" returned: 0 in 0.256s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:59 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-ad20d019-c4ef-4a0e-beec-4fe11be54d9e tempest-ProjectMemberTests-351068705 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d.info is being set with open permissions: ugo+rw Sep 10 20:03:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad20d019-c4ef-4a0e-beec-4fe11be54d9e tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:59 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d.info Sep 10 20:03:59 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:00 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-ad20d019-c4ef-4a0e-beec-4fe11be54d9e tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d.info" returned: 0 in 0.264s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-ad20d019-c4ef-4a0e-beec-4fe11be54d9e tempest-ProjectMemberTests-351068705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.058s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:00 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-ad20d019-c4ef-4a0e-beec-4fe11be54d9e tempest-ProjectMemberTests-351068705 None] Create snapshot completed successfully Sep 10 20:04:01 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-08d096cd-b2ff-4515-9ef5-a79b43b8130b tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-81dacc7d-adae-4877-9c6c-4550707dd270-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:01 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-08d096cd-b2ff-4515-9ef5-a79b43b8130b tempest-ProjectMemberTests-351068705 None] Lock "cinder-81dacc7d-adae-4877-9c6c-4550707dd270-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:01 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-08d096cd-b2ff-4515-9ef5-a79b43b8130b tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-quobyte-88b9ae5c-046e-4a64-9d93-d51d2c64170d" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:01 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-08d096cd-b2ff-4515-9ef5-a79b43b8130b tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-88b9ae5c-046e-4a64-9d93-d51d2c64170d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:01 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-08d096cd-b2ff-4515-9ef5-a79b43b8130b tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-quobyte-81dacc7d-adae-4877-9c6c-4550707dd270" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:01 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-08d096cd-b2ff-4515-9ef5-a79b43b8130b tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-81dacc7d-adae-4877-9c6c-4550707dd270" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:01 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-08d096cd-b2ff-4515-9ef5-a79b43b8130b tempest-ProjectMemberTests-351068705 None] Deleting offline snapshot 81dacc7d-adae-4877-9c6c-4550707dd270 of volume 88b9ae5c-046e-4a64-9d93-d51d2c64170d {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:04:01 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-08d096cd-b2ff-4515-9ef5-a79b43b8130b tempest-ProjectMemberTests-351068705 None] snapshot_file for this snap is: volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d.81dacc7d-adae-4877-9c6c-4550707dd270 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:04:01 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b151dcd-baa3-4482-a81a-34d4ba55f23d]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:04:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08d096cd-b2ff-4515-9ef5-a79b43b8130b tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d.81dacc7d-adae-4877-9c6c-4550707dd270 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:01 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d.81dacc7d-adae-4877-9c6c-4550707dd270 Sep 10 20:04:01 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:01 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08d096cd-b2ff-4515-9ef5-a79b43b8130b tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d.81dacc7d-adae-4877-9c6c-4550707dd270" returned: 0 in 0.416s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:01 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-08d096cd-b2ff-4515-9ef5-a79b43b8130b tempest-ProjectMemberTests-351068705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:04:01 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[83131932-7472-42a9-ac94-e2a1b67c59b9]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:04:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08d096cd-b2ff-4515-9ef5-a79b43b8130b tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:01 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d Sep 10 20:04:01 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:02 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08d096cd-b2ff-4515-9ef5-a79b43b8130b tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d" returned: 0 in 0.368s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08d096cd-b2ff-4515-9ef5-a79b43b8130b tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d.81dacc7d-adae-4877-9c6c-4550707dd270 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:02 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d.81dacc7d-adae-4877-9c6c-4550707dd270 Sep 10 20:04:02 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:02 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08d096cd-b2ff-4515-9ef5-a79b43b8130b tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d.81dacc7d-adae-4877-9c6c-4550707dd270" returned: 0 in 0.342s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08d096cd-b2ff-4515-9ef5-a79b43b8130b tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d.81dacc7d-adae-4877-9c6c-4550707dd270 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:02 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d.81dacc7d-adae-4877-9c6c-4550707dd270 Sep 10 20:04:02 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:02 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-08d096cd-b2ff-4515-9ef5-a79b43b8130b tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d.81dacc7d-adae-4877-9c6c-4550707dd270" returned: 0 in 0.258s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:02 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-08d096cd-b2ff-4515-9ef5-a79b43b8130b tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-81dacc7d-adae-4877-9c6c-4550707dd270" released by "_delete_snapshot" :: held 1.483s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:02 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-08d096cd-b2ff-4515-9ef5-a79b43b8130b tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-88b9ae5c-046e-4a64-9d93-d51d2c64170d" released by "delete_snapshot" :: held 1.509s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:02 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-08d096cd-b2ff-4515-9ef5-a79b43b8130b tempest-ProjectMemberTests-351068705 None] Created reservations ['d8f245b2-eebf-4d09-a464-a11aae4db287', '2872158c-3a46-4dee-82a1-832eec900c56', 'ed7210c6-0b35-4190-992d-2112f7fc02de', '547b9165-3b7c-4090-9a59-8e94f51bcfac'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:04:02 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-08d096cd-b2ff-4515-9ef5-a79b43b8130b tempest-ProjectMemberTests-351068705 None] Delete snapshot completed successfully. Sep 10 20:04:02 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-08d096cd-b2ff-4515-9ef5-a79b43b8130b tempest-ProjectMemberTests-351068705 None] Lock "cinder-81dacc7d-adae-4877-9c6c-4550707dd270-delete_snapshot" released by "delete_snapshot" :: held 1.649s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:03 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5e0c02fe-41c3-46cb-9e88-87e21383cdca tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-88b9ae5c-046e-4a64-9d93-d51d2c64170d-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:03 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5e0c02fe-41c3-46cb-9e88-87e21383cdca tempest-ProjectMemberTests-351068705 None] Lock "cinder-88b9ae5c-046e-4a64-9d93-d51d2c64170d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:03 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5e0c02fe-41c3-46cb-9e88-87e21383cdca tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-quobyte-88b9ae5c-046e-4a64-9d93-d51d2c64170d" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:03 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5e0c02fe-41c3-46cb-9e88-87e21383cdca tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-88b9ae5c-046e-4a64-9d93-d51d2c64170d" acquired by "delete_volume" :: waited 0.021s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:03 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0fa917-a5d0-4853-98ae-df4feb8eb0da]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:04:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5e0c02fe-41c3-46cb-9e88-87e21383cdca tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:03 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d Sep 10 20:04:03 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:03 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5e0c02fe-41c3-46cb-9e88-87e21383cdca tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d" returned: 0 in 0.400s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5e0c02fe-41c3-46cb-9e88-87e21383cdca tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:03 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:04:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:04:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:04:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:04:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:04:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:03 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d Sep 10 20:04:03 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:04 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:04:04 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:04 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5e0c02fe-41c3-46cb-9e88-87e21383cdca tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-88b9ae5c-046e-4a64-9d93-d51d2c64170d" returned: 0 in 0.280s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:04 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5e0c02fe-41c3-46cb-9e88-87e21383cdca tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-88b9ae5c-046e-4a64-9d93-d51d2c64170d" released by "delete_volume" :: held 0.752s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:04 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.339s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:04 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:04:04 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager._thread_info {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:04:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread count: 28 {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:04:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread info: [<_MainThread(MainThread, started 138417491665024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:04:04 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-5e0c02fe-41c3-46cb-9e88-87e21383cdca tempest-ProjectMemberTests-351068705 None] Created reservations ['d833f9c5-9629-491e-a9eb-9aed3e38d4d4', '0a3bfc2a-0265-47bb-8d80-71f93206405b', '717d4806-d5e1-491d-9300-142953e32dca', 'f6862e9f-2aa7-439c-9500-2c0db96a07af'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:04:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5e0c02fe-41c3-46cb-9e88-87e21383cdca tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:04:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5e0c02fe-41c3-46cb-9e88-87e21383cdca tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:04:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5e0c02fe-41c3-46cb-9e88-87e21383cdca tempest-ProjectMemberTests-351068705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:04:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5e0c02fe-41c3-46cb-9e88-87e21383cdca tempest-ProjectMemberTests-351068705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:04:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5e0c02fe-41c3-46cb-9e88-87e21383cdca tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5e0c02fe-41c3-46cb-9e88-87e21383cdca tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:04 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:04:04 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:04 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5e0c02fe-41c3-46cb-9e88-87e21383cdca tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.277s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:04 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-5e0c02fe-41c3-46cb-9e88-87e21383cdca tempest-ProjectMemberTests-351068705 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:04:04 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-5e0c02fe-41c3-46cb-9e88-87e21383cdca tempest-ProjectMemberTests-351068705 None] Deleted volume successfully. Sep 10 20:04:04 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5e0c02fe-41c3-46cb-9e88-87e21383cdca tempest-ProjectMemberTests-351068705 None] Lock "cinder-88b9ae5c-046e-4a64-9d93-d51d2c64170d-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:05 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:04:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] Flow 'volume_create_manager' (7d789b9b-b409-4e7e-ae74-ea603834ff02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:04:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d30903e-e21b-46f1-b5ee-cd3509b52615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d30903e-e21b-46f1-b5ee-cd3509b52615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1244758838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff28f22-43fe-4e27-a27b-84a55243c4e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e934bfdc8641078f63f0e9d068a844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:04:05Z,use_quota=True,user_id='fb77e81596394eb99432bed57c5670e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00551742-a29c-419e-b964-f79d1b3fb88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00551742-a29c-419e-b964-f79d1b3fb88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b906a4be-d3f4-4312-9f29-cc9cd1de801c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b906a4be-d3f4-4312-9f29-cc9cd1de801c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ff28f22-43fe-4e27-a27b-84a55243c4e9', 'volume_name': 'volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d4a71c-e851-44ab-a229-c49c4c37daa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d4a71c-e851-44ab-a229-c49c4c37daa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:05 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe22d28e-8fae-4faa-bcce-1f99bca96b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:05 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] Volume 5ff28f22-43fe-4e27-a27b-84a55243c4e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9', 'volume_size': 1} Sep 10 20:04:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:04:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:04:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1244758838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff28f22-43fe-4e27-a27b-84a55243c4e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e934bfdc8641078f63f0e9d068a844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:04:05Z,use_quota=True,user_id='fb77e81596394eb99432bed57c5670e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:04:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] Creating volume 5ff28f22-43fe-4e27-a27b-84a55243c4e9 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:04:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:04:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:04:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:04:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:04:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:04:05 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:04:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:05 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9 1073741824 Sep 10 20:04:05 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:05 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9 1073741824" returned: 0 in 0.477s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:05 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9 Sep 10 20:04:05 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:05 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9" returned: 0 in 0.253s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:05 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:04:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe22d28e-8fae-4faa-bcce-1f99bca96b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319be6a5-70b2-4ff7-8cf0-b44c97f18fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:06 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] Volume volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9 (5ff28f22-43fe-4e27-a27b-84a55243c4e9): created successfully Sep 10 20:04:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319be6a5-70b2-4ff7-8cf0-b44c97f18fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:06 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] Flow 'volume_create_manager' (7d789b9b-b409-4e7e-ae74-ea603834ff02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:04:06 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-c345d28f-ceb9-4f29-9133-8c801008c0f8 tempest-ProjectMemberTests-351068705 None] Created volume successfully. Sep 10 20:04:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-dc09c939-697d-4772-9763-f0b16c5b9b93 tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:04:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-dc09c939-697d-4772-9763-f0b16c5b9b93 tempest-ProjectMemberTests-351068705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:04:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-dc09c939-697d-4772-9763-f0b16c5b9b93 tempest-ProjectMemberTests-351068705 None] Creating offline snapshot cd09a918-ed64-4fed-af4e-8c7a69aa4621 of volume 5ff28f22-43fe-4e27-a27b-84a55243c4e9 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:04:07 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1597e1-397d-4a0c-8083-9f590a30a000]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:04:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-dc09c939-697d-4772-9763-f0b16c5b9b93 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:07 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9 Sep 10 20:04:07 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:07 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-dc09c939-697d-4772-9763-f0b16c5b9b93 tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9" returned: 0 in 0.358s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-dc09c939-697d-4772-9763-f0b16c5b9b93 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9.cd09a918-ed64-4fed-af4e-8c7a69aa4621 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:07 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9.cd09a918-ed64-4fed-af4e-8c7a69aa4621 1G Sep 10 20:04:07 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:08 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-dc09c939-697d-4772-9763-f0b16c5b9b93 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9.cd09a918-ed64-4fed-af4e-8c7a69aa4621 1G" returned: 0 in 0.402s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-dc09c939-697d-4772-9763-f0b16c5b9b93 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9.cd09a918-ed64-4fed-af4e-8c7a69aa4621 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:08 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9.cd09a918-ed64-4fed-af4e-8c7a69aa4621 Sep 10 20:04:08 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:08 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-dc09c939-697d-4772-9763-f0b16c5b9b93 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9.cd09a918-ed64-4fed-af4e-8c7a69aa4621" returned: 0 in 0.283s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:08 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-dc09c939-697d-4772-9763-f0b16c5b9b93 tempest-ProjectMemberTests-351068705 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9.cd09a918-ed64-4fed-af4e-8c7a69aa4621 is being set with open permissions: ugo+rw Sep 10 20:04:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-dc09c939-697d-4772-9763-f0b16c5b9b93 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9.cd09a918-ed64-4fed-af4e-8c7a69aa4621 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:08 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9.cd09a918-ed64-4fed-af4e-8c7a69aa4621 Sep 10 20:04:08 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:08 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-dc09c939-697d-4772-9763-f0b16c5b9b93 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9.cd09a918-ed64-4fed-af4e-8c7a69aa4621" returned: 0 in 0.250s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:08 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=114,cinder:UPDATE=144,cinder:INSERT=43,cinder:DELETE=10 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:04:08 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=115,cinder:UPDATE=145,cinder:DELETE=15,cinder:INSERT=33 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:04:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-dc09c939-697d-4772-9763-f0b16c5b9b93 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:08 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9.info Sep 10 20:04:08 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:08 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-dc09c939-697d-4772-9763-f0b16c5b9b93 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9.info" returned: 0 in 0.252s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:08 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-dc09c939-697d-4772-9763-f0b16c5b9b93 tempest-ProjectMemberTests-351068705 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9.info is being set with open permissions: ugo+rw Sep 10 20:04:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-dc09c939-697d-4772-9763-f0b16c5b9b93 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:08 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9.info Sep 10 20:04:08 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:09 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-dc09c939-697d-4772-9763-f0b16c5b9b93 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9.info" returned: 0 in 0.255s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-dc09c939-697d-4772-9763-f0b16c5b9b93 tempest-ProjectMemberTests-351068705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.887s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:09 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-dc09c939-697d-4772-9763-f0b16c5b9b93 tempest-ProjectMemberTests-351068705 None] Create snapshot completed successfully Sep 10 20:04:09 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-deebe88b-59ee-4475-9e40-76800469a6f8 tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-cd09a918-ed64-4fed-af4e-8c7a69aa4621-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:09 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-deebe88b-59ee-4475-9e40-76800469a6f8 tempest-ProjectMemberTests-351068705 None] Lock "cinder-cd09a918-ed64-4fed-af4e-8c7a69aa4621-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:09 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-deebe88b-59ee-4475-9e40-76800469a6f8 tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-quobyte-5ff28f22-43fe-4e27-a27b-84a55243c4e9" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:09 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-deebe88b-59ee-4475-9e40-76800469a6f8 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-5ff28f22-43fe-4e27-a27b-84a55243c4e9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:09 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-deebe88b-59ee-4475-9e40-76800469a6f8 tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-quobyte-cd09a918-ed64-4fed-af4e-8c7a69aa4621" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:09 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-deebe88b-59ee-4475-9e40-76800469a6f8 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-cd09a918-ed64-4fed-af4e-8c7a69aa4621" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:09 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-deebe88b-59ee-4475-9e40-76800469a6f8 tempest-ProjectMemberTests-351068705 None] Deleting offline snapshot cd09a918-ed64-4fed-af4e-8c7a69aa4621 of volume 5ff28f22-43fe-4e27-a27b-84a55243c4e9 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:04:09 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-deebe88b-59ee-4475-9e40-76800469a6f8 tempest-ProjectMemberTests-351068705 None] snapshot_file for this snap is: volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9.cd09a918-ed64-4fed-af4e-8c7a69aa4621 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:04:09 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cce3bb-2356-455f-b6d0-7da4655da02c]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:04:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-deebe88b-59ee-4475-9e40-76800469a6f8 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9.cd09a918-ed64-4fed-af4e-8c7a69aa4621 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:09 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9.cd09a918-ed64-4fed-af4e-8c7a69aa4621 Sep 10 20:04:09 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:09 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-deebe88b-59ee-4475-9e40-76800469a6f8 tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9.cd09a918-ed64-4fed-af4e-8c7a69aa4621" returned: 0 in 0.359s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:09 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-deebe88b-59ee-4475-9e40-76800469a6f8 tempest-ProjectMemberTests-351068705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:04:09 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ebe25a-3166-4639-8755-64c606e1c71d]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:04:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-deebe88b-59ee-4475-9e40-76800469a6f8 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:10 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9 Sep 10 20:04:10 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:10 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-deebe88b-59ee-4475-9e40-76800469a6f8 tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9" returned: 0 in 0.404s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-deebe88b-59ee-4475-9e40-76800469a6f8 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9.cd09a918-ed64-4fed-af4e-8c7a69aa4621 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:10 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9.cd09a918-ed64-4fed-af4e-8c7a69aa4621 Sep 10 20:04:10 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:10 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-deebe88b-59ee-4475-9e40-76800469a6f8 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9.cd09a918-ed64-4fed-af4e-8c7a69aa4621" returned: 0 in 0.354s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-deebe88b-59ee-4475-9e40-76800469a6f8 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9.cd09a918-ed64-4fed-af4e-8c7a69aa4621 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:10 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9.cd09a918-ed64-4fed-af4e-8c7a69aa4621 Sep 10 20:04:10 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:10 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-deebe88b-59ee-4475-9e40-76800469a6f8 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9.cd09a918-ed64-4fed-af4e-8c7a69aa4621" returned: 0 in 0.258s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:11 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-deebe88b-59ee-4475-9e40-76800469a6f8 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-cd09a918-ed64-4fed-af4e-8c7a69aa4621" released by "_delete_snapshot" :: held 1.475s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:11 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-deebe88b-59ee-4475-9e40-76800469a6f8 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-5ff28f22-43fe-4e27-a27b-84a55243c4e9" released by "delete_snapshot" :: held 1.502s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:11 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-deebe88b-59ee-4475-9e40-76800469a6f8 tempest-ProjectMemberTests-351068705 None] Created reservations ['0ed85237-b5f9-4367-9811-a0afb75de5a4', 'fdf78ce0-17fd-4774-8aac-74b114758f05', 'cd4fbb58-f8de-4e7b-a44d-f7c163c7ee6b', 'ab60306b-962e-4638-acd8-e9c5607e52cc'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:04:11 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-deebe88b-59ee-4475-9e40-76800469a6f8 tempest-ProjectMemberTests-351068705 None] Delete snapshot completed successfully. Sep 10 20:04:11 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-deebe88b-59ee-4475-9e40-76800469a6f8 tempest-ProjectMemberTests-351068705 None] Lock "cinder-cd09a918-ed64-4fed-af4e-8c7a69aa4621-delete_snapshot" released by "delete_snapshot" :: held 1.653s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:11 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cc4d62af-2b25-4418-9e74-3244653c4276 tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-5ff28f22-43fe-4e27-a27b-84a55243c4e9-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:11 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cc4d62af-2b25-4418-9e74-3244653c4276 tempest-ProjectMemberTests-351068705 None] Lock "cinder-5ff28f22-43fe-4e27-a27b-84a55243c4e9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:11 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cc4d62af-2b25-4418-9e74-3244653c4276 tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-quobyte-5ff28f22-43fe-4e27-a27b-84a55243c4e9" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:11 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cc4d62af-2b25-4418-9e74-3244653c4276 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-5ff28f22-43fe-4e27-a27b-84a55243c4e9" acquired by "delete_volume" :: waited 0.013s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:11 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8331a22-2237-49e8-b6a2-d38ebcabc62a]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:04:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cc4d62af-2b25-4418-9e74-3244653c4276 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:11 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9 Sep 10 20:04:11 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:12 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cc4d62af-2b25-4418-9e74-3244653c4276 tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9" returned: 0 in 0.378s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cc4d62af-2b25-4418-9e74-3244653c4276 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:12 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9 Sep 10 20:04:12 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:12 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cc4d62af-2b25-4418-9e74-3244653c4276 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-5ff28f22-43fe-4e27-a27b-84a55243c4e9" returned: 0 in 0.255s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:12 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cc4d62af-2b25-4418-9e74-3244653c4276 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-5ff28f22-43fe-4e27-a27b-84a55243c4e9" released by "delete_volume" :: held 0.697s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:12 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-cc4d62af-2b25-4418-9e74-3244653c4276 tempest-ProjectMemberTests-351068705 None] Created reservations ['86a5e13d-338a-47c9-8e43-f790971b1d14', '3361ec3b-1799-4774-ba13-b2b280df084a', 'd6f29548-ec11-49a8-b480-ff26aaeebea2', 'e460414a-9c14-4cb1-a5d2-c92a589bb40f'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:04:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cc4d62af-2b25-4418-9e74-3244653c4276 tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:04:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cc4d62af-2b25-4418-9e74-3244653c4276 tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:04:12 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-cc4d62af-2b25-4418-9e74-3244653c4276 tempest-ProjectMemberTests-351068705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:04:12 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-cc4d62af-2b25-4418-9e74-3244653c4276 tempest-ProjectMemberTests-351068705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:04:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-cc4d62af-2b25-4418-9e74-3244653c4276 tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cc4d62af-2b25-4418-9e74-3244653c4276 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:12 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:04:12 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:12 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-cc4d62af-2b25-4418-9e74-3244653c4276 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.268s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:12 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-cc4d62af-2b25-4418-9e74-3244653c4276 tempest-ProjectMemberTests-351068705 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:04:12 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-cc4d62af-2b25-4418-9e74-3244653c4276 tempest-ProjectMemberTests-351068705 None] Deleted volume successfully. Sep 10 20:04:12 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-cc4d62af-2b25-4418-9e74-3244653c4276 tempest-ProjectMemberTests-351068705 None] Lock "cinder-5ff28f22-43fe-4e27-a27b-84a55243c4e9-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:13 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:04:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] Flow 'volume_create_manager' (ac62c369-5c26-4b04-beb6-a823c2c8fddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:04:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c23ac042-0736-43b1-9eb9-4de6de5b363e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c23ac042-0736-43b1-9eb9-4de6de5b363e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1163674807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e934bfdc8641078f63f0e9d068a844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:04:13Z,use_quota=True,user_id='fb77e81596394eb99432bed57c5670e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ad0493-0f50-499c-9dde-71126f3cd4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ad0493-0f50-499c-9dde-71126f3cd4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9de8ed7-abaf-4cd1-9209-0029cb77b871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9de8ed7-abaf-4cd1-9209-0029cb77b871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e', 'volume_name': 'volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2325874-5321-4d83-9e0a-946362154675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2325874-5321-4d83-9e0a-946362154675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:13 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df9ac43-3c8f-4ae6-aa67-6172a717d22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:13 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] Volume 2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e', 'volume_size': 1} Sep 10 20:04:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:04:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:04:13 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1163674807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e934bfdc8641078f63f0e9d068a844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:04:13Z,use_quota=True,user_id='fb77e81596394eb99432bed57c5670e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:04:13 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] Creating volume 2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:04:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:04:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:04:13 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:04:13 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:04:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:13 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:04:13 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:04:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:13 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e 1073741824 Sep 10 20:04:13 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:13 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e 1073741824" returned: 0 in 0.470s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:13 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e Sep 10 20:04:13 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:14 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e" returned: 0 in 0.259s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:04:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df9ac43-3c8f-4ae6-aa67-6172a717d22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff2f5ac-9261-4203-9b5c-e67f8342f665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:14 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] Volume volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e (2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e): created successfully Sep 10 20:04:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff2f5ac-9261-4203-9b5c-e67f8342f665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] Flow 'volume_create_manager' (ac62c369-5c26-4b04-beb6-a823c2c8fddc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:04:14 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-a8c3bede-b189-4306-b475-76823103cae2 tempest-ProjectMemberTests-351068705 None] Created volume successfully. Sep 10 20:04:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-10117a10-a56d-40ed-a044-0c17f8d844f6 tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:04:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-10117a10-a56d-40ed-a044-0c17f8d844f6 tempest-ProjectMemberTests-351068705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:04:15 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-10117a10-a56d-40ed-a044-0c17f8d844f6 tempest-ProjectMemberTests-351068705 None] Creating offline snapshot 350aa13b-5b59-459a-96c3-d71c7f11ff3a of volume 2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:04:15 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[1237678d-7507-4a05-b0a6-109b52ad5286]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:04:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-10117a10-a56d-40ed-a044-0c17f8d844f6 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:15 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e Sep 10 20:04:15 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:15 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-10117a10-a56d-40ed-a044-0c17f8d844f6 tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e" returned: 0 in 0.369s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-10117a10-a56d-40ed-a044-0c17f8d844f6 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e.350aa13b-5b59-459a-96c3-d71c7f11ff3a 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:15 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e.350aa13b-5b59-459a-96c3-d71c7f11ff3a 1G Sep 10 20:04:15 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:16 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-10117a10-a56d-40ed-a044-0c17f8d844f6 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e.350aa13b-5b59-459a-96c3-d71c7f11ff3a 1G" returned: 0 in 0.424s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-10117a10-a56d-40ed-a044-0c17f8d844f6 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e.350aa13b-5b59-459a-96c3-d71c7f11ff3a {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:16 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e.350aa13b-5b59-459a-96c3-d71c7f11ff3a Sep 10 20:04:16 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:16 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-10117a10-a56d-40ed-a044-0c17f8d844f6 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e.350aa13b-5b59-459a-96c3-d71c7f11ff3a" returned: 0 in 0.317s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:16 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-10117a10-a56d-40ed-a044-0c17f8d844f6 tempest-ProjectMemberTests-351068705 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e.350aa13b-5b59-459a-96c3-d71c7f11ff3a is being set with open permissions: ugo+rw Sep 10 20:04:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-10117a10-a56d-40ed-a044-0c17f8d844f6 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e.350aa13b-5b59-459a-96c3-d71c7f11ff3a {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:16 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e.350aa13b-5b59-459a-96c3-d71c7f11ff3a Sep 10 20:04:16 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:16 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-10117a10-a56d-40ed-a044-0c17f8d844f6 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e.350aa13b-5b59-459a-96c3-d71c7f11ff3a" returned: 0 in 0.256s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-10117a10-a56d-40ed-a044-0c17f8d844f6 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:17 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e.info Sep 10 20:04:17 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:17 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-10117a10-a56d-40ed-a044-0c17f8d844f6 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e.info" returned: 0 in 0.261s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:17 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-10117a10-a56d-40ed-a044-0c17f8d844f6 tempest-ProjectMemberTests-351068705 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e.info is being set with open permissions: ugo+rw Sep 10 20:04:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-10117a10-a56d-40ed-a044-0c17f8d844f6 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:17 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e.info Sep 10 20:04:17 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:17 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-10117a10-a56d-40ed-a044-0c17f8d844f6 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e.info" returned: 0 in 0.279s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-10117a10-a56d-40ed-a044-0c17f8d844f6 tempest-ProjectMemberTests-351068705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.990s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:17 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-10117a10-a56d-40ed-a044-0c17f8d844f6 tempest-ProjectMemberTests-351068705 None] Create snapshot completed successfully Sep 10 20:04:17 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7d3df55e-1170-4254-8d99-2b71d8a690bc tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-350aa13b-5b59-459a-96c3-d71c7f11ff3a-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:17 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7d3df55e-1170-4254-8d99-2b71d8a690bc tempest-ProjectMemberTests-351068705 None] Lock "cinder-350aa13b-5b59-459a-96c3-d71c7f11ff3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:17 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7d3df55e-1170-4254-8d99-2b71d8a690bc tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-quobyte-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:17 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7d3df55e-1170-4254-8d99-2b71d8a690bc tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:17 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7d3df55e-1170-4254-8d99-2b71d8a690bc tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-quobyte-350aa13b-5b59-459a-96c3-d71c7f11ff3a" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:17 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7d3df55e-1170-4254-8d99-2b71d8a690bc tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-350aa13b-5b59-459a-96c3-d71c7f11ff3a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:17 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-7d3df55e-1170-4254-8d99-2b71d8a690bc tempest-ProjectMemberTests-351068705 None] Deleting offline snapshot 350aa13b-5b59-459a-96c3-d71c7f11ff3a of volume 2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:04:17 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-7d3df55e-1170-4254-8d99-2b71d8a690bc tempest-ProjectMemberTests-351068705 None] snapshot_file for this snap is: volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e.350aa13b-5b59-459a-96c3-d71c7f11ff3a {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:04:17 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea0f61e-3018-4b0d-9d62-5704ec255d9f]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:04:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7d3df55e-1170-4254-8d99-2b71d8a690bc tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e.350aa13b-5b59-459a-96c3-d71c7f11ff3a {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:17 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e.350aa13b-5b59-459a-96c3-d71c7f11ff3a Sep 10 20:04:17 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:18 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7d3df55e-1170-4254-8d99-2b71d8a690bc tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e.350aa13b-5b59-459a-96c3-d71c7f11ff3a" returned: 0 in 0.458s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:18 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-7d3df55e-1170-4254-8d99-2b71d8a690bc tempest-ProjectMemberTests-351068705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:04:18 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0eabb83-dfe7-491e-b495-fc7a0c2a03a2]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:04:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7d3df55e-1170-4254-8d99-2b71d8a690bc tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:18 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e Sep 10 20:04:18 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:18 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7d3df55e-1170-4254-8d99-2b71d8a690bc tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e" returned: 0 in 0.400s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:18 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7d3df55e-1170-4254-8d99-2b71d8a690bc tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e.350aa13b-5b59-459a-96c3-d71c7f11ff3a {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:18 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e.350aa13b-5b59-459a-96c3-d71c7f11ff3a Sep 10 20:04:18 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:19 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7d3df55e-1170-4254-8d99-2b71d8a690bc tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e.350aa13b-5b59-459a-96c3-d71c7f11ff3a" returned: 0 in 0.350s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7d3df55e-1170-4254-8d99-2b71d8a690bc tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e.350aa13b-5b59-459a-96c3-d71c7f11ff3a {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:19 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e.350aa13b-5b59-459a-96c3-d71c7f11ff3a Sep 10 20:04:19 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:19 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:19 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7d3df55e-1170-4254-8d99-2b71d8a690bc tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e.350aa13b-5b59-459a-96c3-d71c7f11ff3a" returned: 0 in 0.232s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:19 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7d3df55e-1170-4254-8d99-2b71d8a690bc tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-350aa13b-5b59-459a-96c3-d71c7f11ff3a" released by "_delete_snapshot" :: held 1.537s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:19 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7d3df55e-1170-4254-8d99-2b71d8a690bc tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e" released by "delete_snapshot" :: held 1.559s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:19 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-7d3df55e-1170-4254-8d99-2b71d8a690bc tempest-ProjectMemberTests-351068705 None] Created reservations ['5dc45888-d224-4b9d-852a-1b05dfe9da2e', '1ef97edd-2698-4232-85c3-05ea35b45843', '4ac6e1ff-1ac5-4950-9046-7ed65226edfa', 'dc5dc070-172e-4256-8b35-6dae3ee819e7'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:04:19 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-7d3df55e-1170-4254-8d99-2b71d8a690bc tempest-ProjectMemberTests-351068705 None] Delete snapshot completed successfully. Sep 10 20:04:19 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7d3df55e-1170-4254-8d99-2b71d8a690bc tempest-ProjectMemberTests-351068705 None] Lock "cinder-350aa13b-5b59-459a-96c3-d71c7f11ff3a-delete_snapshot" released by "delete_snapshot" :: held 1.699s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:19 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4d9bd668-3de1-428a-adc0-0fbbc79c07b1 tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:19 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4d9bd668-3de1-428a-adc0-0fbbc79c07b1 tempest-ProjectMemberTests-351068705 None] Lock "cinder-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:19 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4d9bd668-3de1-428a-adc0-0fbbc79c07b1 tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-quobyte-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:19 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4d9bd668-3de1-428a-adc0-0fbbc79c07b1 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e" acquired by "delete_volume" :: waited 0.018s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:20 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[daadd99d-735d-4cb8-a655-e56e66ca075c]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:04:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4d9bd668-3de1-428a-adc0-0fbbc79c07b1 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:20 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e Sep 10 20:04:20 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:20 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4d9bd668-3de1-428a-adc0-0fbbc79c07b1 tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e" returned: 0 in 0.357s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4d9bd668-3de1-428a-adc0-0fbbc79c07b1 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:20 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e Sep 10 20:04:20 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:20 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4d9bd668-3de1-428a-adc0-0fbbc79c07b1 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e" returned: 0 in 0.257s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:20 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4d9bd668-3de1-428a-adc0-0fbbc79c07b1 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e" released by "delete_volume" :: held 0.679s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:20 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-4d9bd668-3de1-428a-adc0-0fbbc79c07b1 tempest-ProjectMemberTests-351068705 None] Created reservations ['281fe5dd-f429-4b72-9fb3-01b4463e3a9f', '02b65d2c-8a59-493b-b940-a4fd23a3f34a', '78f7406a-0ea1-41ed-a862-d2b7c2c1f42c', '2682ddeb-34fa-4bf9-a82c-b37457f67a3e'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:04:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-4d9bd668-3de1-428a-adc0-0fbbc79c07b1 tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:04:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-4d9bd668-3de1-428a-adc0-0fbbc79c07b1 tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:04:20 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-4d9bd668-3de1-428a-adc0-0fbbc79c07b1 tempest-ProjectMemberTests-351068705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:04:20 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-4d9bd668-3de1-428a-adc0-0fbbc79c07b1 tempest-ProjectMemberTests-351068705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:04:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-4d9bd668-3de1-428a-adc0-0fbbc79c07b1 tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:20 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4d9bd668-3de1-428a-adc0-0fbbc79c07b1 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:20 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:04:20 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:21 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4d9bd668-3de1-428a-adc0-0fbbc79c07b1 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.297s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:21 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-4d9bd668-3de1-428a-adc0-0fbbc79c07b1 tempest-ProjectMemberTests-351068705 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:04:21 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-4d9bd668-3de1-428a-adc0-0fbbc79c07b1 tempest-ProjectMemberTests-351068705 None] Deleted volume successfully. Sep 10 20:04:21 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4d9bd668-3de1-428a-adc0-0fbbc79c07b1 tempest-ProjectMemberTests-351068705 None] Lock "cinder-2dbd9e44-a3f2-4b8e-ba3b-f58a6156d94e-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:21 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:04:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] Flow 'volume_create_manager' (345b1a9c-76b3-477f-8aa9-64b2a3762bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:04:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09786fa2-e431-44d5-86b8-8625c4707a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09786fa2-e431-44d5-86b8-8625c4707a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-882483922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a5eb2ae-e751-42d3-9ddb-4931a7e3466e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e934bfdc8641078f63f0e9d068a844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:04:22Z,use_quota=True,user_id='fb77e81596394eb99432bed57c5670e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a22f6b5-56e8-43cd-b0d0-fcdcbc3c17a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a22f6b5-56e8-43cd-b0d0-fcdcbc3c17a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (276b29ce-f146-4b7b-ba22-b75070c4a098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (276b29ce-f146-4b7b-ba22-b75070c4a098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a5eb2ae-e751-42d3-9ddb-4931a7e3466e', 'volume_name': 'volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213344aa-cd02-42b7-8030-ac9ca59660ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213344aa-cd02-42b7-8030-ac9ca59660ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:21 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8a6f8c1-261b-43bc-b99e-20244e8506c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:21 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] Volume 6a5eb2ae-e751-42d3-9ddb-4931a7e3466e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e', 'volume_size': 1} Sep 10 20:04:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:04:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:04:21 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-882483922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a5eb2ae-e751-42d3-9ddb-4931a7e3466e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e934bfdc8641078f63f0e9d068a844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:04:22Z,use_quota=True,user_id='fb77e81596394eb99432bed57c5670e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:04:21 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] Creating volume 6a5eb2ae-e751-42d3-9ddb-4931a7e3466e {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:04:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:04:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:04:21 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:04:21 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:04:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:21 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:04:21 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:04:21 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:21 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e 1073741824 Sep 10 20:04:21 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:22 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e 1073741824" returned: 0 in 0.421s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:22 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e Sep 10 20:04:22 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:22 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e" returned: 0 in 0.274s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:22 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:04:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:22 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8a6f8c1-261b-43bc-b99e-20244e8506c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:22 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3497611-a303-4e5c-938d-885d05a1f733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:22 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] Volume volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e (6a5eb2ae-e751-42d3-9ddb-4931a7e3466e): created successfully Sep 10 20:04:22 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3497611-a303-4e5c-938d-885d05a1f733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:22 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] Flow 'volume_create_manager' (345b1a9c-76b3-477f-8aa9-64b2a3762bf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:04:22 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-812ccc81-455d-4958-928c-e11c15b1aa4b tempest-ProjectMemberTests-351068705 None] Created volume successfully. Sep 10 20:04:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-fa268f75-b214-4939-97eb-ff4e5b486e10 tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:04:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-fa268f75-b214-4939-97eb-ff4e5b486e10 tempest-ProjectMemberTests-351068705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:04:22 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-fa268f75-b214-4939-97eb-ff4e5b486e10 tempest-ProjectMemberTests-351068705 None] Creating offline snapshot c64bcb92-4759-4e4f-9cff-002ddc9f4048 of volume 6a5eb2ae-e751-42d3-9ddb-4931a7e3466e {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:04:22 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3370ef-c7bd-4229-9dfa-0d8171148cab]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:04:22 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fa268f75-b214-4939-97eb-ff4e5b486e10 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:22 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e Sep 10 20:04:22 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:23 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fa268f75-b214-4939-97eb-ff4e5b486e10 tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e" returned: 0 in 0.355s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fa268f75-b214-4939-97eb-ff4e5b486e10 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e.c64bcb92-4759-4e4f-9cff-002ddc9f4048 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:23 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e.c64bcb92-4759-4e4f-9cff-002ddc9f4048 1G Sep 10 20:04:23 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:23 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fa268f75-b214-4939-97eb-ff4e5b486e10 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e.c64bcb92-4759-4e4f-9cff-002ddc9f4048 1G" returned: 0 in 0.408s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fa268f75-b214-4939-97eb-ff4e5b486e10 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e.c64bcb92-4759-4e4f-9cff-002ddc9f4048 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:23 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e.c64bcb92-4759-4e4f-9cff-002ddc9f4048 Sep 10 20:04:23 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:23 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fa268f75-b214-4939-97eb-ff4e5b486e10 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e.c64bcb92-4759-4e4f-9cff-002ddc9f4048" returned: 0 in 0.295s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:23 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-fa268f75-b214-4939-97eb-ff4e5b486e10 tempest-ProjectMemberTests-351068705 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e.c64bcb92-4759-4e4f-9cff-002ddc9f4048 is being set with open permissions: ugo+rw Sep 10 20:04:23 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fa268f75-b214-4939-97eb-ff4e5b486e10 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e.c64bcb92-4759-4e4f-9cff-002ddc9f4048 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:23 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e.c64bcb92-4759-4e4f-9cff-002ddc9f4048 Sep 10 20:04:23 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:24 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fa268f75-b214-4939-97eb-ff4e5b486e10 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e.c64bcb92-4759-4e4f-9cff-002ddc9f4048" returned: 0 in 0.258s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fa268f75-b214-4939-97eb-ff4e5b486e10 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:24 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e.info Sep 10 20:04:24 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:24 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fa268f75-b214-4939-97eb-ff4e5b486e10 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e.info" returned: 0 in 0.260s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:24 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-fa268f75-b214-4939-97eb-ff4e5b486e10 tempest-ProjectMemberTests-351068705 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e.info is being set with open permissions: ugo+rw Sep 10 20:04:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fa268f75-b214-4939-97eb-ff4e5b486e10 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:24 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e.info Sep 10 20:04:24 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:24 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fa268f75-b214-4939-97eb-ff4e5b486e10 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e.info" returned: 0 in 0.250s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-fa268f75-b214-4939-97eb-ff4e5b486e10 tempest-ProjectMemberTests-351068705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.901s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:24 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-fa268f75-b214-4939-97eb-ff4e5b486e10 tempest-ProjectMemberTests-351068705 None] Create snapshot completed successfully Sep 10 20:04:24 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5e4ee6d9-b1aa-4df4-abcf-af290f8dba84 tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-c64bcb92-4759-4e4f-9cff-002ddc9f4048-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:24 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5e4ee6d9-b1aa-4df4-abcf-af290f8dba84 tempest-ProjectMemberTests-351068705 None] Lock "cinder-c64bcb92-4759-4e4f-9cff-002ddc9f4048-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:24 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5e4ee6d9-b1aa-4df4-abcf-af290f8dba84 tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-quobyte-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:24 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5e4ee6d9-b1aa-4df4-abcf-af290f8dba84 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:24 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5e4ee6d9-b1aa-4df4-abcf-af290f8dba84 tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-quobyte-c64bcb92-4759-4e4f-9cff-002ddc9f4048" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:24 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5e4ee6d9-b1aa-4df4-abcf-af290f8dba84 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-c64bcb92-4759-4e4f-9cff-002ddc9f4048" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:24 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-5e4ee6d9-b1aa-4df4-abcf-af290f8dba84 tempest-ProjectMemberTests-351068705 None] Deleting offline snapshot c64bcb92-4759-4e4f-9cff-002ddc9f4048 of volume 6a5eb2ae-e751-42d3-9ddb-4931a7e3466e {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:04:24 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-5e4ee6d9-b1aa-4df4-abcf-af290f8dba84 tempest-ProjectMemberTests-351068705 None] snapshot_file for this snap is: volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e.c64bcb92-4759-4e4f-9cff-002ddc9f4048 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:04:24 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3961c9f-b6ae-405a-b104-b5629e67a030]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:04:24 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5e4ee6d9-b1aa-4df4-abcf-af290f8dba84 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e.c64bcb92-4759-4e4f-9cff-002ddc9f4048 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:25 devstack sudo[107764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e.c64bcb92-4759-4e4f-9cff-002ddc9f4048 Sep 10 20:04:25 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:25 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5e4ee6d9-b1aa-4df4-abcf-af290f8dba84 tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e.c64bcb92-4759-4e4f-9cff-002ddc9f4048" returned: 0 in 0.358s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:25 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-5e4ee6d9-b1aa-4df4-abcf-af290f8dba84 tempest-ProjectMemberTests-351068705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:04:25 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3acbbe-78bf-400a-85da-cd202ac3bd4b]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:04:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5e4ee6d9-b1aa-4df4-abcf-af290f8dba84 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:25 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e Sep 10 20:04:25 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:25 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5e4ee6d9-b1aa-4df4-abcf-af290f8dba84 tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e" returned: 0 in 0.382s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:25 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5e4ee6d9-b1aa-4df4-abcf-af290f8dba84 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e.c64bcb92-4759-4e4f-9cff-002ddc9f4048 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:25 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e.c64bcb92-4759-4e4f-9cff-002ddc9f4048 Sep 10 20:04:25 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:26 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5e4ee6d9-b1aa-4df4-abcf-af290f8dba84 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e.c64bcb92-4759-4e4f-9cff-002ddc9f4048" returned: 0 in 0.367s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5e4ee6d9-b1aa-4df4-abcf-af290f8dba84 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e.c64bcb92-4759-4e4f-9cff-002ddc9f4048 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:26 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e.c64bcb92-4759-4e4f-9cff-002ddc9f4048 Sep 10 20:04:26 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:26 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:26 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5e4ee6d9-b1aa-4df4-abcf-af290f8dba84 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e.c64bcb92-4759-4e4f-9cff-002ddc9f4048" returned: 0 in 0.272s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:26 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5e4ee6d9-b1aa-4df4-abcf-af290f8dba84 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-c64bcb92-4759-4e4f-9cff-002ddc9f4048" released by "_delete_snapshot" :: held 1.487s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:26 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5e4ee6d9-b1aa-4df4-abcf-af290f8dba84 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e" released by "delete_snapshot" :: held 1.509s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:26 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-5e4ee6d9-b1aa-4df4-abcf-af290f8dba84 tempest-ProjectMemberTests-351068705 None] Created reservations ['dbd92039-83be-49a6-8d72-9e3a0e8161b3', '8798818f-dd99-41bc-980f-06ff8d592e5a', '6586e7a7-d149-4721-8fd0-1f7aaae4ac5a', '93e64b98-05c7-4d66-aad2-5359fc4a8e44'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:04:26 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-5e4ee6d9-b1aa-4df4-abcf-af290f8dba84 tempest-ProjectMemberTests-351068705 None] Delete snapshot completed successfully. Sep 10 20:04:26 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5e4ee6d9-b1aa-4df4-abcf-af290f8dba84 tempest-ProjectMemberTests-351068705 None] Lock "cinder-c64bcb92-4759-4e4f-9cff-002ddc9f4048-delete_snapshot" released by "delete_snapshot" :: held 1.661s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:27 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-996a3acc-8681-4c76-b437-09e062bbc555 tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:27 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-996a3acc-8681-4c76-b437-09e062bbc555 tempest-ProjectMemberTests-351068705 None] Lock "cinder-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:27 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-996a3acc-8681-4c76-b437-09e062bbc555 tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-quobyte-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:27 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-996a3acc-8681-4c76-b437-09e062bbc555 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e" acquired by "delete_volume" :: waited 0.014s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:27 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf8652c-df82-461a-821c-e4b3e27f73cb]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:04:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-996a3acc-8681-4c76-b437-09e062bbc555 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:27 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e Sep 10 20:04:27 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:27 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-996a3acc-8681-4c76-b437-09e062bbc555 tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e" returned: 0 in 0.400s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-996a3acc-8681-4c76-b437-09e062bbc555 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:27 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e Sep 10 20:04:27 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:27 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:27 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-996a3acc-8681-4c76-b437-09e062bbc555 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e" returned: 0 in 0.254s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:27 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-996a3acc-8681-4c76-b437-09e062bbc555 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e" released by "delete_volume" :: held 0.720s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:27 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-996a3acc-8681-4c76-b437-09e062bbc555 tempest-ProjectMemberTests-351068705 None] Created reservations ['69bdd36a-0567-412b-8fc2-219074f82715', '733cc374-fff5-4194-9c48-a569968cde20', 'b31241d2-56c0-4d9d-a125-cd364181262b', 'fe9dc016-2a0e-4a1f-8ac2-955adf588d90'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:04:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-996a3acc-8681-4c76-b437-09e062bbc555 tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:04:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-996a3acc-8681-4c76-b437-09e062bbc555 tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:04:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-996a3acc-8681-4c76-b437-09e062bbc555 tempest-ProjectMemberTests-351068705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:04:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-996a3acc-8681-4c76-b437-09e062bbc555 tempest-ProjectMemberTests-351068705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:04:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-996a3acc-8681-4c76-b437-09e062bbc555 tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-996a3acc-8681-4c76-b437-09e062bbc555 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:28 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:04:28 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:28 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-996a3acc-8681-4c76-b437-09e062bbc555 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.270s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:28 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-996a3acc-8681-4c76-b437-09e062bbc555 tempest-ProjectMemberTests-351068705 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:04:28 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-996a3acc-8681-4c76-b437-09e062bbc555 tempest-ProjectMemberTests-351068705 None] Deleted volume successfully. Sep 10 20:04:28 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-996a3acc-8681-4c76-b437-09e062bbc555 tempest-ProjectMemberTests-351068705 None] Lock "cinder-6a5eb2ae-e751-42d3-9ddb-4931a7e3466e-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:28 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:04:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] Flow 'volume_create_manager' (5ad3b5d0-122f-4a79-9417-c82fc1ebeea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:04:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a85bc385-3be7-4dcb-90f1-0ad0adde13f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a85bc385-3be7-4dcb-90f1-0ad0adde13f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-42304332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4595c076-e474-4f09-890e-3163297763f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e934bfdc8641078f63f0e9d068a844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:04:29Z,use_quota=True,user_id='fb77e81596394eb99432bed57c5670e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b36d4f8b-a445-4f48-bc1a-d80795d366e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b36d4f8b-a445-4f48-bc1a-d80795d366e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b5ad7e-d30a-43f0-8d0d-472e896ba56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b5ad7e-d30a-43f0-8d0d-472e896ba56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4595c076-e474-4f09-890e-3163297763f3', 'volume_name': 'volume-4595c076-e474-4f09-890e-3163297763f3', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (390d355a-a884-4bd1-af5c-4fe43e887559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (390d355a-a884-4bd1-af5c-4fe43e887559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:28 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c080ed8-3234-44b7-aede-ea5c1c536027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:28 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] Volume 4595c076-e474-4f09-890e-3163297763f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4595c076-e474-4f09-890e-3163297763f3', 'volume_size': 1} Sep 10 20:04:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:04:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:04:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-42304332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4595c076-e474-4f09-890e-3163297763f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e934bfdc8641078f63f0e9d068a844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:04:29Z,use_quota=True,user_id='fb77e81596394eb99432bed57c5670e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:04:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] Creating volume 4595c076-e474-4f09-890e-3163297763f3 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:04:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:04:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:04:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:04:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:04:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:28 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:04:28 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:04:28 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:28 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3 1073741824 Sep 10 20:04:28 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:29 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3 1073741824" returned: 0 in 0.440s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:29 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3 Sep 10 20:04:29 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:29 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3" returned: 0 in 0.245s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:29 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:04:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c080ed8-3234-44b7-aede-ea5c1c536027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4595c076-e474-4f09-890e-3163297763f3', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68abe79e-4178-4c15-a7f7-8d325e514795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:29 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] Volume volume-4595c076-e474-4f09-890e-3163297763f3 (4595c076-e474-4f09-890e-3163297763f3): created successfully Sep 10 20:04:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68abe79e-4178-4c15-a7f7-8d325e514795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:29 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] Flow 'volume_create_manager' (5ad3b5d0-122f-4a79-9417-c82fc1ebeea5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:04:29 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-b3d1cf4f-d220-45db-99da-4c234af51d9d tempest-ProjectMemberTests-351068705 None] Created volume successfully. Sep 10 20:04:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-937ff71b-da07-4306-bb54-72d090c608c5 tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:04:29 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-937ff71b-da07-4306-bb54-72d090c608c5 tempest-ProjectMemberTests-351068705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:04:29 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-937ff71b-da07-4306-bb54-72d090c608c5 tempest-ProjectMemberTests-351068705 None] Creating offline snapshot aeacf672-dab1-4794-b0b5-44f7f0b5de83 of volume 4595c076-e474-4f09-890e-3163297763f3 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:04:30 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c5724d-9cff-4ca5-9b1d-bb727dc1e46f]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:04:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-937ff71b-da07-4306-bb54-72d090c608c5 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:30 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3 Sep 10 20:04:30 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:30 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-937ff71b-da07-4306-bb54-72d090c608c5 tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3" returned: 0 in 0.400s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-937ff71b-da07-4306-bb54-72d090c608c5 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3.aeacf672-dab1-4794-b0b5-44f7f0b5de83 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:30 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3.aeacf672-dab1-4794-b0b5-44f7f0b5de83 1G Sep 10 20:04:30 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:30 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-937ff71b-da07-4306-bb54-72d090c608c5 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3.aeacf672-dab1-4794-b0b5-44f7f0b5de83 1G" returned: 0 in 0.413s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:30 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-937ff71b-da07-4306-bb54-72d090c608c5 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4595c076-e474-4f09-890e-3163297763f3 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3.aeacf672-dab1-4794-b0b5-44f7f0b5de83 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:30 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4595c076-e474-4f09-890e-3163297763f3 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3.aeacf672-dab1-4794-b0b5-44f7f0b5de83 Sep 10 20:04:30 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:31 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-937ff71b-da07-4306-bb54-72d090c608c5 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4595c076-e474-4f09-890e-3163297763f3 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3.aeacf672-dab1-4794-b0b5-44f7f0b5de83" returned: 0 in 0.294s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:31 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-937ff71b-da07-4306-bb54-72d090c608c5 tempest-ProjectMemberTests-351068705 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3.aeacf672-dab1-4794-b0b5-44f7f0b5de83 is being set with open permissions: ugo+rw Sep 10 20:04:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-937ff71b-da07-4306-bb54-72d090c608c5 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3.aeacf672-dab1-4794-b0b5-44f7f0b5de83 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:31 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3.aeacf672-dab1-4794-b0b5-44f7f0b5de83 Sep 10 20:04:31 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:31 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-937ff71b-da07-4306-bb54-72d090c608c5 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3.aeacf672-dab1-4794-b0b5-44f7f0b5de83" returned: 0 in 0.286s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-937ff71b-da07-4306-bb54-72d090c608c5 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:31 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3.info Sep 10 20:04:31 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:31 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-937ff71b-da07-4306-bb54-72d090c608c5 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3.info" returned: 0 in 0.255s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:31 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-937ff71b-da07-4306-bb54-72d090c608c5 tempest-ProjectMemberTests-351068705 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3.info is being set with open permissions: ugo+rw Sep 10 20:04:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-937ff71b-da07-4306-bb54-72d090c608c5 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:31 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3.info Sep 10 20:04:31 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:31 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-937ff71b-da07-4306-bb54-72d090c608c5 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3.info" returned: 0 in 0.236s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:31 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-937ff71b-da07-4306-bb54-72d090c608c5 tempest-ProjectMemberTests-351068705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.972s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:31 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-937ff71b-da07-4306-bb54-72d090c608c5 tempest-ProjectMemberTests-351068705 None] Create snapshot completed successfully Sep 10 20:04:32 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-8deaf456-d57e-4999-b131-be8c54d64778 tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-aeacf672-dab1-4794-b0b5-44f7f0b5de83-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:32 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-8deaf456-d57e-4999-b131-be8c54d64778 tempest-ProjectMemberTests-351068705 None] Lock "cinder-aeacf672-dab1-4794-b0b5-44f7f0b5de83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:32 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-8deaf456-d57e-4999-b131-be8c54d64778 tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-quobyte-4595c076-e474-4f09-890e-3163297763f3" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:32 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-8deaf456-d57e-4999-b131-be8c54d64778 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-4595c076-e474-4f09-890e-3163297763f3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:32 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-8deaf456-d57e-4999-b131-be8c54d64778 tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-quobyte-aeacf672-dab1-4794-b0b5-44f7f0b5de83" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:32 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-8deaf456-d57e-4999-b131-be8c54d64778 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-aeacf672-dab1-4794-b0b5-44f7f0b5de83" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:32 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-8deaf456-d57e-4999-b131-be8c54d64778 tempest-ProjectMemberTests-351068705 None] Deleting offline snapshot aeacf672-dab1-4794-b0b5-44f7f0b5de83 of volume 4595c076-e474-4f09-890e-3163297763f3 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:04:32 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-8deaf456-d57e-4999-b131-be8c54d64778 tempest-ProjectMemberTests-351068705 None] snapshot_file for this snap is: volume-4595c076-e474-4f09-890e-3163297763f3.aeacf672-dab1-4794-b0b5-44f7f0b5de83 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:04:32 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fd83d4-6749-4169-b9b6-c4799ed768c8]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:04:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8deaf456-d57e-4999-b131-be8c54d64778 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3.aeacf672-dab1-4794-b0b5-44f7f0b5de83 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:32 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3.aeacf672-dab1-4794-b0b5-44f7f0b5de83 Sep 10 20:04:32 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:32 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8deaf456-d57e-4999-b131-be8c54d64778 tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3.aeacf672-dab1-4794-b0b5-44f7f0b5de83" returned: 0 in 0.354s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:32 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-8deaf456-d57e-4999-b131-be8c54d64778 tempest-ProjectMemberTests-351068705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4595c076-e474-4f09-890e-3163297763f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:04:32 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53dc973-f17b-47de-b9fe-b99f513ce080]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:04:32 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8deaf456-d57e-4999-b131-be8c54d64778 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:32 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3 Sep 10 20:04:32 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:33 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8deaf456-d57e-4999-b131-be8c54d64778 tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3" returned: 0 in 0.389s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8deaf456-d57e-4999-b131-be8c54d64778 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3.aeacf672-dab1-4794-b0b5-44f7f0b5de83 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:33 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3.aeacf672-dab1-4794-b0b5-44f7f0b5de83 Sep 10 20:04:33 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:33 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8deaf456-d57e-4999-b131-be8c54d64778 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3.aeacf672-dab1-4794-b0b5-44f7f0b5de83" returned: 0 in 0.346s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8deaf456-d57e-4999-b131-be8c54d64778 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3.aeacf672-dab1-4794-b0b5-44f7f0b5de83 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:33 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3.aeacf672-dab1-4794-b0b5-44f7f0b5de83 Sep 10 20:04:33 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:33 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:33 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8deaf456-d57e-4999-b131-be8c54d64778 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3.aeacf672-dab1-4794-b0b5-44f7f0b5de83" returned: 0 in 0.246s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:33 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-8deaf456-d57e-4999-b131-be8c54d64778 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-aeacf672-dab1-4794-b0b5-44f7f0b5de83" released by "_delete_snapshot" :: held 1.426s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:33 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-8deaf456-d57e-4999-b131-be8c54d64778 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-4595c076-e474-4f09-890e-3163297763f3" released by "delete_snapshot" :: held 1.448s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:33 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-8deaf456-d57e-4999-b131-be8c54d64778 tempest-ProjectMemberTests-351068705 None] Created reservations ['bb3768ad-c561-4ae6-a151-d76110616af1', '6077cbd1-ffbb-43ae-960f-f98212202057', '5ad8038a-40bd-40b3-aa7a-1d2449776ec4', '08f7b0ab-0b46-41c9-ae54-af39b08d13b6'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:04:33 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-8deaf456-d57e-4999-b131-be8c54d64778 tempest-ProjectMemberTests-351068705 None] Delete snapshot completed successfully. Sep 10 20:04:33 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-8deaf456-d57e-4999-b131-be8c54d64778 tempest-ProjectMemberTests-351068705 None] Lock "cinder-aeacf672-dab1-4794-b0b5-44f7f0b5de83-delete_snapshot" released by "delete_snapshot" :: held 1.589s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:34 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-654c4d3a-bcfa-42e3-bd6b-a69855f979b3 tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-4595c076-e474-4f09-890e-3163297763f3-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:34 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-654c4d3a-bcfa-42e3-bd6b-a69855f979b3 tempest-ProjectMemberTests-351068705 None] Lock "cinder-4595c076-e474-4f09-890e-3163297763f3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:34 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-654c4d3a-bcfa-42e3-bd6b-a69855f979b3 tempest-ProjectMemberTests-351068705 None] Acquiring lock "cinder-quobyte-4595c076-e474-4f09-890e-3163297763f3" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:34 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-654c4d3a-bcfa-42e3-bd6b-a69855f979b3 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-4595c076-e474-4f09-890e-3163297763f3" acquired by "delete_volume" :: waited 0.015s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:34 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6debee-be05-4ed4-8c8a-21aac3de10b3]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:04:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-654c4d3a-bcfa-42e3-bd6b-a69855f979b3 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:34 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3 Sep 10 20:04:34 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:34 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-654c4d3a-bcfa-42e3-bd6b-a69855f979b3 tempest-ProjectMemberTests-351068705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3" returned: 0 in 0.382s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-654c4d3a-bcfa-42e3-bd6b-a69855f979b3 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:34 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3 Sep 10 20:04:34 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:35 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-654c4d3a-bcfa-42e3-bd6b-a69855f979b3 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-4595c076-e474-4f09-890e-3163297763f3" returned: 0 in 0.263s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:35 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-654c4d3a-bcfa-42e3-bd6b-a69855f979b3 tempest-ProjectMemberTests-351068705 None] Lock "cinder-quobyte-4595c076-e474-4f09-890e-3163297763f3" released by "delete_volume" :: held 0.702s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:35 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-654c4d3a-bcfa-42e3-bd6b-a69855f979b3 tempest-ProjectMemberTests-351068705 None] Created reservations ['926032b0-d609-4c67-bbbb-3cca7a8d23fa', '36e2f6e0-08cd-41a6-9284-b66682941cd7', '7930bcbb-6190-4282-93f2-724bd16fd7fd', '4ad1baaf-a87c-4c2a-990b-768d8326122a'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:04:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-654c4d3a-bcfa-42e3-bd6b-a69855f979b3 tempest-ProjectMemberTests-351068705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:04:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-654c4d3a-bcfa-42e3-bd6b-a69855f979b3 tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:04:35 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-654c4d3a-bcfa-42e3-bd6b-a69855f979b3 tempest-ProjectMemberTests-351068705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:04:35 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-654c4d3a-bcfa-42e3-bd6b-a69855f979b3 tempest-ProjectMemberTests-351068705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:04:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-654c4d3a-bcfa-42e3-bd6b-a69855f979b3 tempest-ProjectMemberTests-351068705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-654c4d3a-bcfa-42e3-bd6b-a69855f979b3 tempest-ProjectMemberTests-351068705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:35 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:04:35 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:35 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-654c4d3a-bcfa-42e3-bd6b-a69855f979b3 tempest-ProjectMemberTests-351068705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.261s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:35 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-654c4d3a-bcfa-42e3-bd6b-a69855f979b3 tempest-ProjectMemberTests-351068705 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:04:35 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-654c4d3a-bcfa-42e3-bd6b-a69855f979b3 tempest-ProjectMemberTests-351068705 None] Deleted volume successfully. Sep 10 20:04:35 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-654c4d3a-bcfa-42e3-bd6b-a69855f979b3 tempest-ProjectMemberTests-351068705 None] Lock "cinder-4595c076-e474-4f09-890e-3163297763f3-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:39 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:04:39 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] Flow 'volume_create_manager' (f0586017-7ebd-4ff7-b6b4-032896204711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:04:39 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (485a19db-44aa-4a25-9984-87af195d86b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:39 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (485a19db-44aa-4a25-9984-87af195d86b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2053434513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab4aadda-7ee4-4e6e-9154-42f8392ba872,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d4bc2bbaad4058afe49e04653c5424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:04:39Z,use_quota=True,user_id='cd4ba87cb23341159e973c8c4d98d141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:39 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe5b520-4e63-4a0c-bcd5-0c8b2a2c3f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:39 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe5b520-4e63-4a0c-bcd5-0c8b2a2c3f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:39 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a2633d-7f2b-4fae-bd63-6cfa5745ffd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:39 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a2633d-7f2b-4fae-bd63-6cfa5745ffd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab4aadda-7ee4-4e6e-9154-42f8392ba872', 'volume_name': 'volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:39 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fac89c7b-97cd-43a9-8185-4fbcdcac2ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:39 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fac89c7b-97cd-43a9-8185-4fbcdcac2ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:39 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5736bd8-b5d0-40c8-a350-48fda232d56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:39 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] Volume ab4aadda-7ee4-4e6e-9154-42f8392ba872: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872', 'volume_size': 1} Sep 10 20:04:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:04:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:04:39 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2053434513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab4aadda-7ee4-4e6e-9154-42f8392ba872,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d4bc2bbaad4058afe49e04653c5424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:04:39Z,use_quota=True,user_id='cd4ba87cb23341159e973c8c4d98d141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:04:39 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] Creating volume ab4aadda-7ee4-4e6e-9154-42f8392ba872 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:04:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:04:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:04:39 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:04:39 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:04:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:39 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:04:39 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:04:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:39 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872 1073741824 Sep 10 20:04:39 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:39 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872 1073741824" returned: 0 in 0.419s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:40 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872 Sep 10 20:04:40 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:40 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872" returned: 0 in 0.261s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:04:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5736bd8-b5d0-40c8-a350-48fda232d56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f3fa28-5429-4750-bd66-5b2c38b1b0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:40 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] Volume volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872 (ab4aadda-7ee4-4e6e-9154-42f8392ba872): created successfully Sep 10 20:04:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f3fa28-5429-4750-bd66-5b2c38b1b0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] Flow 'volume_create_manager' (f0586017-7ebd-4ff7-b6b4-032896204711) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:04:40 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-4f075977-8023-461e-95b2-5e338d9ef258 tempest-ProjectReaderTests-1276446227 None] Created volume successfully. Sep 10 20:04:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7c58627f-e3b0-4af0-be7b-41695b753801 tempest-ProjectReaderTests-1276446227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:04:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7c58627f-e3b0-4af0-be7b-41695b753801 tempest-ProjectReaderTests-1276446227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:04:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-7c58627f-e3b0-4af0-be7b-41695b753801 tempest-ProjectReaderTests-1276446227 None] Creating offline snapshot 61010c4a-ee59-42ed-b94e-d21219bf08f9 of volume ab4aadda-7ee4-4e6e-9154-42f8392ba872 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:04:40 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7e2aa4-4d6a-4326-8246-9335440919c4]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:04:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7c58627f-e3b0-4af0-be7b-41695b753801 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:40 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872 Sep 10 20:04:40 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:41 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7c58627f-e3b0-4af0-be7b-41695b753801 tempest-ProjectReaderTests-1276446227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872" returned: 0 in 0.379s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7c58627f-e3b0-4af0-be7b-41695b753801 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872.61010c4a-ee59-42ed-b94e-d21219bf08f9 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:41 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872.61010c4a-ee59-42ed-b94e-d21219bf08f9 1G Sep 10 20:04:41 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:41 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7c58627f-e3b0-4af0-be7b-41695b753801 tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872.61010c4a-ee59-42ed-b94e-d21219bf08f9 1G" returned: 0 in 0.397s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7c58627f-e3b0-4af0-be7b-41695b753801 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872.61010c4a-ee59-42ed-b94e-d21219bf08f9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:41 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872.61010c4a-ee59-42ed-b94e-d21219bf08f9 Sep 10 20:04:41 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:41 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7c58627f-e3b0-4af0-be7b-41695b753801 tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872.61010c4a-ee59-42ed-b94e-d21219bf08f9" returned: 0 in 0.307s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:41 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-7c58627f-e3b0-4af0-be7b-41695b753801 tempest-ProjectReaderTests-1276446227 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872.61010c4a-ee59-42ed-b94e-d21219bf08f9 is being set with open permissions: ugo+rw Sep 10 20:04:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7c58627f-e3b0-4af0-be7b-41695b753801 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872.61010c4a-ee59-42ed-b94e-d21219bf08f9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:41 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872.61010c4a-ee59-42ed-b94e-d21219bf08f9 Sep 10 20:04:41 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:42 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7c58627f-e3b0-4af0-be7b-41695b753801 tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872.61010c4a-ee59-42ed-b94e-d21219bf08f9" returned: 0 in 0.271s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7c58627f-e3b0-4af0-be7b-41695b753801 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:42 devstack sudo[107921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872.info Sep 10 20:04:42 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:42 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7c58627f-e3b0-4af0-be7b-41695b753801 tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872.info" returned: 0 in 0.287s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:42 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-7c58627f-e3b0-4af0-be7b-41695b753801 tempest-ProjectReaderTests-1276446227 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872.info is being set with open permissions: ugo+rw Sep 10 20:04:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7c58627f-e3b0-4af0-be7b-41695b753801 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:42 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872.info Sep 10 20:04:42 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:42 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7c58627f-e3b0-4af0-be7b-41695b753801 tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872.info" returned: 0 in 0.274s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7c58627f-e3b0-4af0-be7b-41695b753801 tempest-ProjectReaderTests-1276446227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.994s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:42 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-7c58627f-e3b0-4af0-be7b-41695b753801 tempest-ProjectReaderTests-1276446227 None] Create snapshot completed successfully Sep 10 20:04:42 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4a1b77a6-1dd7-4f6e-abde-8195a8dfd05f tempest-ProjectReaderTests-1276446227 None] Acquiring lock "cinder-61010c4a-ee59-42ed-b94e-d21219bf08f9-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:42 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4a1b77a6-1dd7-4f6e-abde-8195a8dfd05f tempest-ProjectReaderTests-1276446227 None] Lock "cinder-61010c4a-ee59-42ed-b94e-d21219bf08f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:42 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4a1b77a6-1dd7-4f6e-abde-8195a8dfd05f tempest-ProjectReaderTests-1276446227 None] Acquiring lock "cinder-quobyte-ab4aadda-7ee4-4e6e-9154-42f8392ba872" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:42 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4a1b77a6-1dd7-4f6e-abde-8195a8dfd05f tempest-ProjectReaderTests-1276446227 None] Lock "cinder-quobyte-ab4aadda-7ee4-4e6e-9154-42f8392ba872" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:42 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4a1b77a6-1dd7-4f6e-abde-8195a8dfd05f tempest-ProjectReaderTests-1276446227 None] Acquiring lock "cinder-quobyte-61010c4a-ee59-42ed-b94e-d21219bf08f9" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4a1b77a6-1dd7-4f6e-abde-8195a8dfd05f tempest-ProjectReaderTests-1276446227 None] Lock "cinder-quobyte-61010c4a-ee59-42ed-b94e-d21219bf08f9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-4a1b77a6-1dd7-4f6e-abde-8195a8dfd05f tempest-ProjectReaderTests-1276446227 None] Deleting offline snapshot 61010c4a-ee59-42ed-b94e-d21219bf08f9 of volume ab4aadda-7ee4-4e6e-9154-42f8392ba872 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:04:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-4a1b77a6-1dd7-4f6e-abde-8195a8dfd05f tempest-ProjectReaderTests-1276446227 None] snapshot_file for this snap is: volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872.61010c4a-ee59-42ed-b94e-d21219bf08f9 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:04:43 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[f197500c-adef-4ccb-ba04-0f0dff20be20]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:04:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4a1b77a6-1dd7-4f6e-abde-8195a8dfd05f tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872.61010c4a-ee59-42ed-b94e-d21219bf08f9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:43 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872.61010c4a-ee59-42ed-b94e-d21219bf08f9 Sep 10 20:04:43 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:43 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4a1b77a6-1dd7-4f6e-abde-8195a8dfd05f tempest-ProjectReaderTests-1276446227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872.61010c4a-ee59-42ed-b94e-d21219bf08f9" returned: 0 in 0.377s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-4a1b77a6-1dd7-4f6e-abde-8195a8dfd05f tempest-ProjectReaderTests-1276446227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:04:43 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3e6c37-db4f-4f45-8483-6a1151dbc443]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:04:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4a1b77a6-1dd7-4f6e-abde-8195a8dfd05f tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:43 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872 Sep 10 20:04:43 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:43 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4a1b77a6-1dd7-4f6e-abde-8195a8dfd05f tempest-ProjectReaderTests-1276446227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872" returned: 0 in 0.386s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4a1b77a6-1dd7-4f6e-abde-8195a8dfd05f tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872.61010c4a-ee59-42ed-b94e-d21219bf08f9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:43 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872.61010c4a-ee59-42ed-b94e-d21219bf08f9 Sep 10 20:04:43 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:44 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4a1b77a6-1dd7-4f6e-abde-8195a8dfd05f tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872.61010c4a-ee59-42ed-b94e-d21219bf08f9" returned: 0 in 0.362s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4a1b77a6-1dd7-4f6e-abde-8195a8dfd05f tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872.61010c4a-ee59-42ed-b94e-d21219bf08f9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:44 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872.61010c4a-ee59-42ed-b94e-d21219bf08f9 Sep 10 20:04:44 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:44 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-4a1b77a6-1dd7-4f6e-abde-8195a8dfd05f tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872.61010c4a-ee59-42ed-b94e-d21219bf08f9" returned: 0 in 0.291s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4a1b77a6-1dd7-4f6e-abde-8195a8dfd05f tempest-ProjectReaderTests-1276446227 None] Lock "cinder-quobyte-61010c4a-ee59-42ed-b94e-d21219bf08f9" released by "_delete_snapshot" :: held 1.525s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4a1b77a6-1dd7-4f6e-abde-8195a8dfd05f tempest-ProjectReaderTests-1276446227 None] Lock "cinder-quobyte-ab4aadda-7ee4-4e6e-9154-42f8392ba872" released by "delete_snapshot" :: held 1.550s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:44 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-4a1b77a6-1dd7-4f6e-abde-8195a8dfd05f tempest-ProjectReaderTests-1276446227 None] Created reservations ['cdde9580-d59d-43dc-a469-bc3808c40b30', 'cd4f978b-fbe7-4d84-86bc-4413a1478efa', 'f528c03c-1cca-417f-96f6-0c39061bfbd3', 'ca1895cb-4d6a-48c1-85ff-79a68971383c'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:04:44 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-4a1b77a6-1dd7-4f6e-abde-8195a8dfd05f tempest-ProjectReaderTests-1276446227 None] Delete snapshot completed successfully. Sep 10 20:04:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-4a1b77a6-1dd7-4f6e-abde-8195a8dfd05f tempest-ProjectReaderTests-1276446227 None] Lock "cinder-61010c4a-ee59-42ed-b94e-d21219bf08f9-delete_snapshot" released by "delete_snapshot" :: held 1.713s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:45 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9b77a754-5d93-4f9a-b752-08dea5cafce3 tempest-ProjectReaderTests-1276446227 None] Acquiring lock "cinder-ab4aadda-7ee4-4e6e-9154-42f8392ba872-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:45 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9b77a754-5d93-4f9a-b752-08dea5cafce3 tempest-ProjectReaderTests-1276446227 None] Lock "cinder-ab4aadda-7ee4-4e6e-9154-42f8392ba872-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:45 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9b77a754-5d93-4f9a-b752-08dea5cafce3 tempest-ProjectReaderTests-1276446227 None] Acquiring lock "cinder-quobyte-ab4aadda-7ee4-4e6e-9154-42f8392ba872" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:45 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9b77a754-5d93-4f9a-b752-08dea5cafce3 tempest-ProjectReaderTests-1276446227 None] Lock "cinder-quobyte-ab4aadda-7ee4-4e6e-9154-42f8392ba872" acquired by "delete_volume" :: waited 0.015s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:45 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c085c8c-c14d-4f70-8d2e-cf69925f8474]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:04:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9b77a754-5d93-4f9a-b752-08dea5cafce3 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:45 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872 Sep 10 20:04:45 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:45 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9b77a754-5d93-4f9a-b752-08dea5cafce3 tempest-ProjectReaderTests-1276446227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872" returned: 0 in 0.391s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9b77a754-5d93-4f9a-b752-08dea5cafce3 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:45 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872 Sep 10 20:04:45 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:45 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9b77a754-5d93-4f9a-b752-08dea5cafce3 tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-ab4aadda-7ee4-4e6e-9154-42f8392ba872" returned: 0 in 0.245s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:45 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9b77a754-5d93-4f9a-b752-08dea5cafce3 tempest-ProjectReaderTests-1276446227 None] Lock "cinder-quobyte-ab4aadda-7ee4-4e6e-9154-42f8392ba872" released by "delete_volume" :: held 0.695s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:45 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-9b77a754-5d93-4f9a-b752-08dea5cafce3 tempest-ProjectReaderTests-1276446227 None] Created reservations ['081c205e-1d82-46b7-8f65-44a65eccc6db', '79ed0d1b-2ded-48fc-8b48-8458e3bbd4fc', '02444f36-0387-4d4f-9827-26afb0433982', '6d2f01f4-f6a6-45ca-93e7-cb1e61132fb7'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:04:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9b77a754-5d93-4f9a-b752-08dea5cafce3 tempest-ProjectReaderTests-1276446227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:04:45 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9b77a754-5d93-4f9a-b752-08dea5cafce3 tempest-ProjectReaderTests-1276446227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:04:45 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9b77a754-5d93-4f9a-b752-08dea5cafce3 tempest-ProjectReaderTests-1276446227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:04:46 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-9b77a754-5d93-4f9a-b752-08dea5cafce3 tempest-ProjectReaderTests-1276446227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:04:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-9b77a754-5d93-4f9a-b752-08dea5cafce3 tempest-ProjectReaderTests-1276446227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9b77a754-5d93-4f9a-b752-08dea5cafce3 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:46 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:04:46 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:46 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-9b77a754-5d93-4f9a-b752-08dea5cafce3 tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.305s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:46 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-9b77a754-5d93-4f9a-b752-08dea5cafce3 tempest-ProjectReaderTests-1276446227 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:04:46 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-9b77a754-5d93-4f9a-b752-08dea5cafce3 tempest-ProjectReaderTests-1276446227 None] Deleted volume successfully. Sep 10 20:04:46 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-9b77a754-5d93-4f9a-b752-08dea5cafce3 tempest-ProjectReaderTests-1276446227 None] Lock "cinder-ab4aadda-7ee4-4e6e-9154-42f8392ba872-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:46 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:04:46 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] Flow 'volume_create_manager' (5f6da473-6ca0-4ab4-86df-49d2208ebada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:04:46 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5d7e4de-a42f-45e1-9c3c-5b090813c911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:46 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5d7e4de-a42f-45e1-9c3c-5b090813c911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1679362198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22759390-3e28-4783-bb23-a888b38f33b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d4bc2bbaad4058afe49e04653c5424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:04:47Z,use_quota=True,user_id='cd4ba87cb23341159e973c8c4d98d141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:46 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2086156-999a-418a-826e-b74b99153322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:46 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2086156-999a-418a-826e-b74b99153322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:46 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (988ecbed-3e86-43aa-b587-bc9c86d99745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:46 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (988ecbed-3e86-43aa-b587-bc9c86d99745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22759390-3e28-4783-bb23-a888b38f33b8', 'volume_name': 'volume-22759390-3e28-4783-bb23-a888b38f33b8', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:46 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8cbcc8-823e-45c4-a7a4-61d0bd7911b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:46 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8cbcc8-823e-45c4-a7a4-61d0bd7911b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:46 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18e4be7-1a66-4e9e-9226-1d2bdba08ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:46 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] Volume 22759390-3e28-4783-bb23-a888b38f33b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22759390-3e28-4783-bb23-a888b38f33b8', 'volume_size': 1} Sep 10 20:04:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:04:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:04:46 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1679362198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22759390-3e28-4783-bb23-a888b38f33b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d4bc2bbaad4058afe49e04653c5424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:04:47Z,use_quota=True,user_id='cd4ba87cb23341159e973c8c4d98d141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:04:46 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] Creating volume 22759390-3e28-4783-bb23-a888b38f33b8 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:04:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:04:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:04:46 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:04:46 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:04:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:46 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:04:46 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:04:46 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:46 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8 1073741824 Sep 10 20:04:46 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:47 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8 1073741824" returned: 0 in 0.442s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:47 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8 Sep 10 20:04:47 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:47 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8" returned: 0 in 0.268s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:47 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:04:47 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18e4be7-1a66-4e9e-9226-1d2bdba08ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22759390-3e28-4783-bb23-a888b38f33b8', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0358ef9b-94d0-41b9-a4cc-5da8d26d19ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:47 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] Volume volume-22759390-3e28-4783-bb23-a888b38f33b8 (22759390-3e28-4783-bb23-a888b38f33b8): created successfully Sep 10 20:04:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0358ef9b-94d0-41b9-a4cc-5da8d26d19ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:47 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] Flow 'volume_create_manager' (5f6da473-6ca0-4ab4-86df-49d2208ebada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:04:47 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-7e51f76f-ecb7-41b6-bac6-3df87e1fab4f tempest-ProjectReaderTests-1276446227 None] Created volume successfully. Sep 10 20:04:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-05d93c90-0785-448f-b096-172304fed871 tempest-ProjectReaderTests-1276446227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:04:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-05d93c90-0785-448f-b096-172304fed871 tempest-ProjectReaderTests-1276446227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:04:49 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-05d93c90-0785-448f-b096-172304fed871 tempest-ProjectReaderTests-1276446227 None] Creating offline snapshot 2fceac5e-9333-432b-9562-02e5637074c9 of volume 22759390-3e28-4783-bb23-a888b38f33b8 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:04:49 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bb75e8-29e1-4e14-a519-beed4c3730d9]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:04:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-05d93c90-0785-448f-b096-172304fed871 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:49 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8 Sep 10 20:04:49 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:49 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-05d93c90-0785-448f-b096-172304fed871 tempest-ProjectReaderTests-1276446227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8" returned: 0 in 0.389s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:49 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-05d93c90-0785-448f-b096-172304fed871 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8.2fceac5e-9333-432b-9562-02e5637074c9 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:49 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8.2fceac5e-9333-432b-9562-02e5637074c9 1G Sep 10 20:04:49 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:50 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-05d93c90-0785-448f-b096-172304fed871 tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8.2fceac5e-9333-432b-9562-02e5637074c9 1G" returned: 0 in 0.450s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-05d93c90-0785-448f-b096-172304fed871 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22759390-3e28-4783-bb23-a888b38f33b8 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8.2fceac5e-9333-432b-9562-02e5637074c9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:50 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22759390-3e28-4783-bb23-a888b38f33b8 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8.2fceac5e-9333-432b-9562-02e5637074c9 Sep 10 20:04:50 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:50 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-05d93c90-0785-448f-b096-172304fed871 tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22759390-3e28-4783-bb23-a888b38f33b8 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8.2fceac5e-9333-432b-9562-02e5637074c9" returned: 0 in 0.325s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:50 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-05d93c90-0785-448f-b096-172304fed871 tempest-ProjectReaderTests-1276446227 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8.2fceac5e-9333-432b-9562-02e5637074c9 is being set with open permissions: ugo+rw Sep 10 20:04:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-05d93c90-0785-448f-b096-172304fed871 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8.2fceac5e-9333-432b-9562-02e5637074c9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:50 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8.2fceac5e-9333-432b-9562-02e5637074c9 Sep 10 20:04:50 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:50 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-05d93c90-0785-448f-b096-172304fed871 tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8.2fceac5e-9333-432b-9562-02e5637074c9" returned: 0 in 0.257s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-05d93c90-0785-448f-b096-172304fed871 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:50 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8.info Sep 10 20:04:50 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:50 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-05d93c90-0785-448f-b096-172304fed871 tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8.info" returned: 0 in 0.259s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:50 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-05d93c90-0785-448f-b096-172304fed871 tempest-ProjectReaderTests-1276446227 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8.info is being set with open permissions: ugo+rw Sep 10 20:04:50 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-05d93c90-0785-448f-b096-172304fed871 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:50 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8.info Sep 10 20:04:50 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:51 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-05d93c90-0785-448f-b096-172304fed871 tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8.info" returned: 0 in 0.267s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:51 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-05d93c90-0785-448f-b096-172304fed871 tempest-ProjectReaderTests-1276446227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.049s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:51 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-05d93c90-0785-448f-b096-172304fed871 tempest-ProjectReaderTests-1276446227 None] Create snapshot completed successfully Sep 10 20:04:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b9749240-f9ba-4698-9e7e-e198da5654ad tempest-ProjectReaderTests-1276446227 None] Acquiring lock "cinder-2fceac5e-9333-432b-9562-02e5637074c9-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b9749240-f9ba-4698-9e7e-e198da5654ad tempest-ProjectReaderTests-1276446227 None] Lock "cinder-2fceac5e-9333-432b-9562-02e5637074c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b9749240-f9ba-4698-9e7e-e198da5654ad tempest-ProjectReaderTests-1276446227 None] Acquiring lock "cinder-quobyte-22759390-3e28-4783-bb23-a888b38f33b8" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b9749240-f9ba-4698-9e7e-e198da5654ad tempest-ProjectReaderTests-1276446227 None] Lock "cinder-quobyte-22759390-3e28-4783-bb23-a888b38f33b8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b9749240-f9ba-4698-9e7e-e198da5654ad tempest-ProjectReaderTests-1276446227 None] Acquiring lock "cinder-quobyte-2fceac5e-9333-432b-9562-02e5637074c9" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:52 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b9749240-f9ba-4698-9e7e-e198da5654ad tempest-ProjectReaderTests-1276446227 None] Lock "cinder-quobyte-2fceac5e-9333-432b-9562-02e5637074c9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:52 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-b9749240-f9ba-4698-9e7e-e198da5654ad tempest-ProjectReaderTests-1276446227 None] Deleting offline snapshot 2fceac5e-9333-432b-9562-02e5637074c9 of volume 22759390-3e28-4783-bb23-a888b38f33b8 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:04:52 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-b9749240-f9ba-4698-9e7e-e198da5654ad tempest-ProjectReaderTests-1276446227 None] snapshot_file for this snap is: volume-22759390-3e28-4783-bb23-a888b38f33b8.2fceac5e-9333-432b-9562-02e5637074c9 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:04:52 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[690b8c75-6914-438b-b19f-9a4fce489b46]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:04:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b9749240-f9ba-4698-9e7e-e198da5654ad tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8.2fceac5e-9333-432b-9562-02e5637074c9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:52 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8.2fceac5e-9333-432b-9562-02e5637074c9 Sep 10 20:04:52 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:52 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b9749240-f9ba-4698-9e7e-e198da5654ad tempest-ProjectReaderTests-1276446227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8.2fceac5e-9333-432b-9562-02e5637074c9" returned: 0 in 0.383s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:52 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-b9749240-f9ba-4698-9e7e-e198da5654ad tempest-ProjectReaderTests-1276446227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22759390-3e28-4783-bb23-a888b38f33b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:04:52 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adfac10-1c14-441c-9ceb-f0a4149afe62]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:04:52 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b9749240-f9ba-4698-9e7e-e198da5654ad tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:52 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8 Sep 10 20:04:52 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:53 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b9749240-f9ba-4698-9e7e-e198da5654ad tempest-ProjectReaderTests-1276446227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8" returned: 0 in 0.378s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b9749240-f9ba-4698-9e7e-e198da5654ad tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8.2fceac5e-9333-432b-9562-02e5637074c9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:53 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8.2fceac5e-9333-432b-9562-02e5637074c9 Sep 10 20:04:53 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:53 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b9749240-f9ba-4698-9e7e-e198da5654ad tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8.2fceac5e-9333-432b-9562-02e5637074c9" returned: 0 in 0.371s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b9749240-f9ba-4698-9e7e-e198da5654ad tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8.2fceac5e-9333-432b-9562-02e5637074c9 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:53 devstack sudo[108014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8.2fceac5e-9333-432b-9562-02e5637074c9 Sep 10 20:04:53 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:53 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:53 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-b9749240-f9ba-4698-9e7e-e198da5654ad tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8.2fceac5e-9333-432b-9562-02e5637074c9" returned: 0 in 0.284s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b9749240-f9ba-4698-9e7e-e198da5654ad tempest-ProjectReaderTests-1276446227 None] Lock "cinder-quobyte-2fceac5e-9333-432b-9562-02e5637074c9" released by "_delete_snapshot" :: held 1.525s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:53 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b9749240-f9ba-4698-9e7e-e198da5654ad tempest-ProjectReaderTests-1276446227 None] Lock "cinder-quobyte-22759390-3e28-4783-bb23-a888b38f33b8" released by "delete_snapshot" :: held 1.552s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:53 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-b9749240-f9ba-4698-9e7e-e198da5654ad tempest-ProjectReaderTests-1276446227 None] Created reservations ['82b0c07d-b78c-4fc7-89db-66e4d3493a00', '15f8af5d-fdf8-4d80-adeb-dc3fb559b0b4', '66df7229-dd25-4528-9e36-12213bd8c84c', '022131d6-2c23-4bf5-98fe-af8e984db54e'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:04:54 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-b9749240-f9ba-4698-9e7e-e198da5654ad tempest-ProjectReaderTests-1276446227 None] Delete snapshot completed successfully. Sep 10 20:04:54 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-b9749240-f9ba-4698-9e7e-e198da5654ad tempest-ProjectReaderTests-1276446227 None] Lock "cinder-2fceac5e-9333-432b-9562-02e5637074c9-delete_snapshot" released by "delete_snapshot" :: held 1.719s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:54 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3f33caae-04d0-409d-944c-a781e37b4880 tempest-ProjectReaderTests-1276446227 None] Acquiring lock "cinder-22759390-3e28-4783-bb23-a888b38f33b8-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:54 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3f33caae-04d0-409d-944c-a781e37b4880 tempest-ProjectReaderTests-1276446227 None] Lock "cinder-22759390-3e28-4783-bb23-a888b38f33b8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:54 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3f33caae-04d0-409d-944c-a781e37b4880 tempest-ProjectReaderTests-1276446227 None] Acquiring lock "cinder-quobyte-22759390-3e28-4783-bb23-a888b38f33b8" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:54 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3f33caae-04d0-409d-944c-a781e37b4880 tempest-ProjectReaderTests-1276446227 None] Lock "cinder-quobyte-22759390-3e28-4783-bb23-a888b38f33b8" acquired by "delete_volume" :: waited 0.021s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:54 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[08332538-3faa-4a5f-8df6-3195950a1414]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:04:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3f33caae-04d0-409d-944c-a781e37b4880 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:54 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8 Sep 10 20:04:54 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:54 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3f33caae-04d0-409d-944c-a781e37b4880 tempest-ProjectReaderTests-1276446227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8" returned: 0 in 0.374s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:54 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3f33caae-04d0-409d-944c-a781e37b4880 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:55 devstack sudo[108022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8 Sep 10 20:04:55 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:55 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3f33caae-04d0-409d-944c-a781e37b4880 tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-22759390-3e28-4783-bb23-a888b38f33b8" returned: 0 in 0.271s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:55 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3f33caae-04d0-409d-944c-a781e37b4880 tempest-ProjectReaderTests-1276446227 None] Lock "cinder-quobyte-22759390-3e28-4783-bb23-a888b38f33b8" released by "delete_volume" :: held 0.702s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:55 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-3f33caae-04d0-409d-944c-a781e37b4880 tempest-ProjectReaderTests-1276446227 None] Created reservations ['17098ae6-150d-48bb-bf65-ece6a9e64118', 'cae4b657-6881-4df7-884e-7679f25ad9fc', 'f2a462b7-8481-4c99-ab2d-7b98d92fd6e8', '2494351a-2d2f-411a-b0e9-7396136f659c'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:04:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3f33caae-04d0-409d-944c-a781e37b4880 tempest-ProjectReaderTests-1276446227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:04:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3f33caae-04d0-409d-944c-a781e37b4880 tempest-ProjectReaderTests-1276446227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:04:55 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3f33caae-04d0-409d-944c-a781e37b4880 tempest-ProjectReaderTests-1276446227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:04:55 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3f33caae-04d0-409d-944c-a781e37b4880 tempest-ProjectReaderTests-1276446227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:04:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3f33caae-04d0-409d-944c-a781e37b4880 tempest-ProjectReaderTests-1276446227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3f33caae-04d0-409d-944c-a781e37b4880 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:55 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:04:55 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:55 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:55 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3f33caae-04d0-409d-944c-a781e37b4880 tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.271s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:55 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-3f33caae-04d0-409d-944c-a781e37b4880 tempest-ProjectReaderTests-1276446227 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:04:55 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-3f33caae-04d0-409d-944c-a781e37b4880 tempest-ProjectReaderTests-1276446227 None] Deleted volume successfully. Sep 10 20:04:55 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3f33caae-04d0-409d-944c-a781e37b4880 tempest-ProjectReaderTests-1276446227 None] Lock "cinder-22759390-3e28-4783-bb23-a888b38f33b8-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:04:56 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:04:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] Flow 'volume_create_manager' (561abf9e-b302-4a3e-9199-de134c3047e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:04:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c33032-12ef-4d6c-905c-9481f4debdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c33032-12ef-4d6c-905c-9481f4debdf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-580232929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c063b764-6384-461c-86b1-8ecc34a084a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d4bc2bbaad4058afe49e04653c5424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:04:56Z,use_quota=True,user_id='cd4ba87cb23341159e973c8c4d98d141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b083b14a-a4cf-403a-8fd9-cdf33ff6b1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b083b14a-a4cf-403a-8fd9-cdf33ff6b1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18b3604-943b-4042-b606-e26e9902b2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18b3604-943b-4042-b606-e26e9902b2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c063b764-6384-461c-86b1-8ecc34a084a8', 'volume_name': 'volume-c063b764-6384-461c-86b1-8ecc34a084a8', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df17450c-e765-43de-9f7e-a4a1af7d5c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df17450c-e765-43de-9f7e-a4a1af7d5c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:56 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d295ba-bf0e-4ee5-8609-1ec2228acb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:56 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] Volume c063b764-6384-461c-86b1-8ecc34a084a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c063b764-6384-461c-86b1-8ecc34a084a8', 'volume_size': 1} Sep 10 20:04:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:04:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:04:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-580232929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c063b764-6384-461c-86b1-8ecc34a084a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d4bc2bbaad4058afe49e04653c5424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:04:56Z,use_quota=True,user_id='cd4ba87cb23341159e973c8c4d98d141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:04:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] Creating volume c063b764-6384-461c-86b1-8ecc34a084a8 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:04:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:04:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:04:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:04:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:04:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:56 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:04:56 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:04:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:56 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8 1073741824 Sep 10 20:04:56 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:56 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8 1073741824" returned: 0 in 0.452s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:56 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:56 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8 Sep 10 20:04:56 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:57 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8" returned: 0 in 0.267s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:57 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:04:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d295ba-bf0e-4ee5-8609-1ec2228acb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c063b764-6384-461c-86b1-8ecc34a084a8', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (444016ca-5add-458e-a123-c5aa5c5d4541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:57 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] Volume volume-c063b764-6384-461c-86b1-8ecc34a084a8 (c063b764-6384-461c-86b1-8ecc34a084a8): created successfully Sep 10 20:04:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (444016ca-5add-458e-a123-c5aa5c5d4541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:57 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] Flow 'volume_create_manager' (561abf9e-b302-4a3e-9199-de134c3047e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:04:57 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-8f655874-2436-4e5f-8995-b86a5cad77ed tempest-ProjectReaderTests-1276446227 None] Created volume successfully. Sep 10 20:04:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-81d52099-2f1c-4bb1-9cc1-985dd4cfa9c5 tempest-ProjectReaderTests-1276446227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:04:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-81d52099-2f1c-4bb1-9cc1-985dd4cfa9c5 tempest-ProjectReaderTests-1276446227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:04:57 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-81d52099-2f1c-4bb1-9cc1-985dd4cfa9c5 tempest-ProjectReaderTests-1276446227 None] Creating offline snapshot 63f23ddc-a439-4b98-8c2c-1d9c47514b08 of volume c063b764-6384-461c-86b1-8ecc34a084a8 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:04:57 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[549dbd33-e9a8-43b4-9d46-8326c83987c8]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:04:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-81d52099-2f1c-4bb1-9cc1-985dd4cfa9c5 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:57 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8 Sep 10 20:04:57 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:57 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-81d52099-2f1c-4bb1-9cc1-985dd4cfa9c5 tempest-ProjectReaderTests-1276446227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8" returned: 0 in 0.389s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:57 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-81d52099-2f1c-4bb1-9cc1-985dd4cfa9c5 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8.63f23ddc-a439-4b98-8c2c-1d9c47514b08 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:57 devstack sudo[108042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8.63f23ddc-a439-4b98-8c2c-1d9c47514b08 1G Sep 10 20:04:57 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:58 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-81d52099-2f1c-4bb1-9cc1-985dd4cfa9c5 tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8.63f23ddc-a439-4b98-8c2c-1d9c47514b08 1G" returned: 0 in 0.407s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-81d52099-2f1c-4bb1-9cc1-985dd4cfa9c5 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c063b764-6384-461c-86b1-8ecc34a084a8 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8.63f23ddc-a439-4b98-8c2c-1d9c47514b08 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:58 devstack sudo[108048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c063b764-6384-461c-86b1-8ecc34a084a8 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8.63f23ddc-a439-4b98-8c2c-1d9c47514b08 Sep 10 20:04:58 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:58 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-81d52099-2f1c-4bb1-9cc1-985dd4cfa9c5 tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c063b764-6384-461c-86b1-8ecc34a084a8 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8.63f23ddc-a439-4b98-8c2c-1d9c47514b08" returned: 0 in 0.298s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:58 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-81d52099-2f1c-4bb1-9cc1-985dd4cfa9c5 tempest-ProjectReaderTests-1276446227 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8.63f23ddc-a439-4b98-8c2c-1d9c47514b08 is being set with open permissions: ugo+rw Sep 10 20:04:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-81d52099-2f1c-4bb1-9cc1-985dd4cfa9c5 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8.63f23ddc-a439-4b98-8c2c-1d9c47514b08 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:58 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8.63f23ddc-a439-4b98-8c2c-1d9c47514b08 Sep 10 20:04:58 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:58 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-81d52099-2f1c-4bb1-9cc1-985dd4cfa9c5 tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8.63f23ddc-a439-4b98-8c2c-1d9c47514b08" returned: 0 in 0.268s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:58 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-81d52099-2f1c-4bb1-9cc1-985dd4cfa9c5 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:58 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8.info Sep 10 20:04:58 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:59 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-81d52099-2f1c-4bb1-9cc1-985dd4cfa9c5 tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8.info" returned: 0 in 0.261s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:59 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-81d52099-2f1c-4bb1-9cc1-985dd4cfa9c5 tempest-ProjectReaderTests-1276446227 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8.info is being set with open permissions: ugo+rw Sep 10 20:04:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-81d52099-2f1c-4bb1-9cc1-985dd4cfa9c5 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:59 devstack sudo[108059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8.info Sep 10 20:04:59 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:59 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-81d52099-2f1c-4bb1-9cc1-985dd4cfa9c5 tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8.info" returned: 0 in 0.254s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-81d52099-2f1c-4bb1-9cc1-985dd4cfa9c5 tempest-ProjectReaderTests-1276446227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.958s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:59 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-81d52099-2f1c-4bb1-9cc1-985dd4cfa9c5 tempest-ProjectReaderTests-1276446227 None] Create snapshot completed successfully Sep 10 20:04:59 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-52c1407d-fd3d-4d42-8927-fce6ff2e4ba4 tempest-ProjectReaderTests-1276446227 None] Acquiring lock "cinder-63f23ddc-a439-4b98-8c2c-1d9c47514b08-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:59 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-52c1407d-fd3d-4d42-8927-fce6ff2e4ba4 tempest-ProjectReaderTests-1276446227 None] Lock "cinder-63f23ddc-a439-4b98-8c2c-1d9c47514b08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:59 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-52c1407d-fd3d-4d42-8927-fce6ff2e4ba4 tempest-ProjectReaderTests-1276446227 None] Acquiring lock "cinder-quobyte-c063b764-6384-461c-86b1-8ecc34a084a8" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:59 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-52c1407d-fd3d-4d42-8927-fce6ff2e4ba4 tempest-ProjectReaderTests-1276446227 None] Lock "cinder-quobyte-c063b764-6384-461c-86b1-8ecc34a084a8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:59 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-52c1407d-fd3d-4d42-8927-fce6ff2e4ba4 tempest-ProjectReaderTests-1276446227 None] Acquiring lock "cinder-quobyte-63f23ddc-a439-4b98-8c2c-1d9c47514b08" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:04:59 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-52c1407d-fd3d-4d42-8927-fce6ff2e4ba4 tempest-ProjectReaderTests-1276446227 None] Lock "cinder-quobyte-63f23ddc-a439-4b98-8c2c-1d9c47514b08" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:04:59 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-52c1407d-fd3d-4d42-8927-fce6ff2e4ba4 tempest-ProjectReaderTests-1276446227 None] Deleting offline snapshot 63f23ddc-a439-4b98-8c2c-1d9c47514b08 of volume c063b764-6384-461c-86b1-8ecc34a084a8 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:04:59 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-52c1407d-fd3d-4d42-8927-fce6ff2e4ba4 tempest-ProjectReaderTests-1276446227 None] snapshot_file for this snap is: volume-c063b764-6384-461c-86b1-8ecc34a084a8.63f23ddc-a439-4b98-8c2c-1d9c47514b08 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:04:59 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33f179e-0a17-4f6e-aa8b-53b91a194d8c]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:04:59 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-52c1407d-fd3d-4d42-8927-fce6ff2e4ba4 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8.63f23ddc-a439-4b98-8c2c-1d9c47514b08 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:00 devstack sudo[108062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8.63f23ddc-a439-4b98-8c2c-1d9c47514b08 Sep 10 20:05:00 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:00 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-52c1407d-fd3d-4d42-8927-fce6ff2e4ba4 tempest-ProjectReaderTests-1276446227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8.63f23ddc-a439-4b98-8c2c-1d9c47514b08" returned: 0 in 0.395s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:00 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-52c1407d-fd3d-4d42-8927-fce6ff2e4ba4 tempest-ProjectReaderTests-1276446227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c063b764-6384-461c-86b1-8ecc34a084a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:05:00 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[7071c5d3-77bf-4b4d-a06a-53d56d9b4e6f]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:05:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-52c1407d-fd3d-4d42-8927-fce6ff2e4ba4 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:00 devstack sudo[108069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8 Sep 10 20:05:00 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:00 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-52c1407d-fd3d-4d42-8927-fce6ff2e4ba4 tempest-ProjectReaderTests-1276446227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8" returned: 0 in 0.374s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:00 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-52c1407d-fd3d-4d42-8927-fce6ff2e4ba4 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8.63f23ddc-a439-4b98-8c2c-1d9c47514b08 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:00 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8.63f23ddc-a439-4b98-8c2c-1d9c47514b08 Sep 10 20:05:00 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:01 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-52c1407d-fd3d-4d42-8927-fce6ff2e4ba4 tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8.63f23ddc-a439-4b98-8c2c-1d9c47514b08" returned: 0 in 0.356s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-52c1407d-fd3d-4d42-8927-fce6ff2e4ba4 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8.63f23ddc-a439-4b98-8c2c-1d9c47514b08 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:01 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8.63f23ddc-a439-4b98-8c2c-1d9c47514b08 Sep 10 20:05:01 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:01 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:01 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-52c1407d-fd3d-4d42-8927-fce6ff2e4ba4 tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8.63f23ddc-a439-4b98-8c2c-1d9c47514b08" returned: 0 in 0.251s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:01 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-52c1407d-fd3d-4d42-8927-fce6ff2e4ba4 tempest-ProjectReaderTests-1276446227 None] Lock "cinder-quobyte-63f23ddc-a439-4b98-8c2c-1d9c47514b08" released by "_delete_snapshot" :: held 1.468s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:05:01 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-52c1407d-fd3d-4d42-8927-fce6ff2e4ba4 tempest-ProjectReaderTests-1276446227 None] Lock "cinder-quobyte-c063b764-6384-461c-86b1-8ecc34a084a8" released by "delete_snapshot" :: held 1.491s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:05:01 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-52c1407d-fd3d-4d42-8927-fce6ff2e4ba4 tempest-ProjectReaderTests-1276446227 None] Created reservations ['dc4012c3-1bfa-4c88-9529-d9e12836de4f', '31c5b8f1-ee22-421d-9aaa-71b71b067473', 'c975417e-e772-4e7d-9e06-f2613eb4c63f', 'fd2ce731-7b7f-4240-b54a-2d00a6fc8d7a'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:05:01 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-52c1407d-fd3d-4d42-8927-fce6ff2e4ba4 tempest-ProjectReaderTests-1276446227 None] Delete snapshot completed successfully. Sep 10 20:05:01 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-52c1407d-fd3d-4d42-8927-fce6ff2e4ba4 tempest-ProjectReaderTests-1276446227 None] Lock "cinder-63f23ddc-a439-4b98-8c2c-1d9c47514b08-delete_snapshot" released by "delete_snapshot" :: held 1.645s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:05:02 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-db8886f2-bcdd-4fd1-a9ec-34b46dea7d9f tempest-ProjectReaderTests-1276446227 None] Acquiring lock "cinder-c063b764-6384-461c-86b1-8ecc34a084a8-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:05:02 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-db8886f2-bcdd-4fd1-a9ec-34b46dea7d9f tempest-ProjectReaderTests-1276446227 None] Lock "cinder-c063b764-6384-461c-86b1-8ecc34a084a8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:05:02 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-db8886f2-bcdd-4fd1-a9ec-34b46dea7d9f tempest-ProjectReaderTests-1276446227 None] Acquiring lock "cinder-quobyte-c063b764-6384-461c-86b1-8ecc34a084a8" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:05:02 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-db8886f2-bcdd-4fd1-a9ec-34b46dea7d9f tempest-ProjectReaderTests-1276446227 None] Lock "cinder-quobyte-c063b764-6384-461c-86b1-8ecc34a084a8" acquired by "delete_volume" :: waited 0.016s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:05:02 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[c907b3fa-c201-4347-84e3-b5cd28971621]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:05:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-db8886f2-bcdd-4fd1-a9ec-34b46dea7d9f tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:02 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8 Sep 10 20:05:02 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:02 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-db8886f2-bcdd-4fd1-a9ec-34b46dea7d9f tempest-ProjectReaderTests-1276446227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8" returned: 0 in 0.365s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-db8886f2-bcdd-4fd1-a9ec-34b46dea7d9f tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:02 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8 Sep 10 20:05:02 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:02 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-db8886f2-bcdd-4fd1-a9ec-34b46dea7d9f tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c063b764-6384-461c-86b1-8ecc34a084a8" returned: 0 in 0.271s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:02 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-db8886f2-bcdd-4fd1-a9ec-34b46dea7d9f tempest-ProjectReaderTests-1276446227 None] Lock "cinder-quobyte-c063b764-6384-461c-86b1-8ecc34a084a8" released by "delete_volume" :: held 0.700s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:05:02 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-db8886f2-bcdd-4fd1-a9ec-34b46dea7d9f tempest-ProjectReaderTests-1276446227 None] Created reservations ['540683fe-9ea0-4b98-8ed3-08e312c381d6', 'acd566e0-64f1-4c1b-82d3-8a03f002528e', '4cfb46c1-129d-463e-aeca-1128910452f5', 'aedb1616-0072-45fe-8a34-ead5ec77681e'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:05:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-db8886f2-bcdd-4fd1-a9ec-34b46dea7d9f tempest-ProjectReaderTests-1276446227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-db8886f2-bcdd-4fd1-a9ec-34b46dea7d9f tempest-ProjectReaderTests-1276446227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:02 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-db8886f2-bcdd-4fd1-a9ec-34b46dea7d9f tempest-ProjectReaderTests-1276446227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:05:02 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-db8886f2-bcdd-4fd1-a9ec-34b46dea7d9f tempest-ProjectReaderTests-1276446227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:05:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-db8886f2-bcdd-4fd1-a9ec-34b46dea7d9f tempest-ProjectReaderTests-1276446227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:02 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-db8886f2-bcdd-4fd1-a9ec-34b46dea7d9f tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:02 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:05:02 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:03 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-db8886f2-bcdd-4fd1-a9ec-34b46dea7d9f tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.273s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-db8886f2-bcdd-4fd1-a9ec-34b46dea7d9f tempest-ProjectReaderTests-1276446227 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:05:03 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-db8886f2-bcdd-4fd1-a9ec-34b46dea7d9f tempest-ProjectReaderTests-1276446227 None] Deleted volume successfully. Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-db8886f2-bcdd-4fd1-a9ec-34b46dea7d9f tempest-ProjectReaderTests-1276446227 None] Lock "cinder-c063b764-6384-461c-86b1-8ecc34a084a8-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] Flow 'volume_create_manager' (7196ddbe-53e1-4a63-a2af-10c5e9dd7dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (305ee1f3-1d72-4c87-aa29-2ba36d11c798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (305ee1f3-1d72-4c87-aa29-2ba36d11c798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-544460634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a0f5799-d3fa-43a6-89de-f071bbe49d82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d4bc2bbaad4058afe49e04653c5424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:05:04Z,use_quota=True,user_id='cd4ba87cb23341159e973c8c4d98d141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63426b6-9c08-406f-aaa1-63d35ee3a094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63426b6-9c08-406f-aaa1-63d35ee3a094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d5892e0-53b5-42be-b490-6c457a498a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d5892e0-53b5-42be-b490-6c457a498a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a0f5799-d3fa-43a6-89de-f071bbe49d82', 'volume_name': 'volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (445005c4-4b52-4235-80d4-9b7630540da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (445005c4-4b52-4235-80d4-9b7630540da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecde6a90-ffae-45ae-86e0-0e150f87924e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:03 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] Volume 1a0f5799-d3fa-43a6-89de-f071bbe49d82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82', 'volume_size': 1} Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-544460634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a0f5799-d3fa-43a6-89de-f071bbe49d82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d4bc2bbaad4058afe49e04653c5424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:05:04Z,use_quota=True,user_id='cd4ba87cb23341159e973c8c4d98d141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] Creating volume 1a0f5799-d3fa-43a6-89de-f071bbe49d82 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:05:03 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:03 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82 1073741824 Sep 10 20:05:03 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:04 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:05:04 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:04 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82 1073741824" returned: 0 in 0.450s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:04 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.280s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:04 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:05:04 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager._thread_info {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:05:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread count: 28 {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:05:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread info: [<_MainThread(MainThread, started 138417491665024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:05:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:04 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82 Sep 10 20:05:04 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:04 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82" returned: 0 in 0.235s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:05:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecde6a90-ffae-45ae-86e0-0e150f87924e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57a900f6-9fac-4085-830a-686eb6d90fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:04 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] Volume volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82 (1a0f5799-d3fa-43a6-89de-f071bbe49d82): created successfully Sep 10 20:05:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57a900f6-9fac-4085-830a-686eb6d90fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] Flow 'volume_create_manager' (7196ddbe-53e1-4a63-a2af-10c5e9dd7dbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:05:04 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-be9e0e98-2750-4ba0-94bc-543407222288 tempest-ProjectReaderTests-1276446227 None] Created volume successfully. Sep 10 20:05:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-8e40a285-7aa9-4a26-bb68-f13e72149c7c tempest-ProjectReaderTests-1276446227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-8e40a285-7aa9-4a26-bb68-f13e72149c7c tempest-ProjectReaderTests-1276446227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:04 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-8e40a285-7aa9-4a26-bb68-f13e72149c7c tempest-ProjectReaderTests-1276446227 None] Creating offline snapshot a426199c-cfaa-4ad0-a8e6-64f254c0b3c7 of volume 1a0f5799-d3fa-43a6-89de-f071bbe49d82 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:05:04 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[897c60a8-6dd0-407e-9bfb-e0612dbd9e9e]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:05:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8e40a285-7aa9-4a26-bb68-f13e72149c7c tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:05 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82 Sep 10 20:05:05 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:05 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8e40a285-7aa9-4a26-bb68-f13e72149c7c tempest-ProjectReaderTests-1276446227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82" returned: 0 in 0.381s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8e40a285-7aa9-4a26-bb68-f13e72149c7c tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82.a426199c-cfaa-4ad0-a8e6-64f254c0b3c7 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:05 devstack sudo[108112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82.a426199c-cfaa-4ad0-a8e6-64f254c0b3c7 1G Sep 10 20:05:05 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:05 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8e40a285-7aa9-4a26-bb68-f13e72149c7c tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82.a426199c-cfaa-4ad0-a8e6-64f254c0b3c7 1G" returned: 0 in 0.406s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8e40a285-7aa9-4a26-bb68-f13e72149c7c tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82.a426199c-cfaa-4ad0-a8e6-64f254c0b3c7 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:05 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82.a426199c-cfaa-4ad0-a8e6-64f254c0b3c7 Sep 10 20:05:05 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:05 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8e40a285-7aa9-4a26-bb68-f13e72149c7c tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82.a426199c-cfaa-4ad0-a8e6-64f254c0b3c7" returned: 0 in 0.288s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:05 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-8e40a285-7aa9-4a26-bb68-f13e72149c7c tempest-ProjectReaderTests-1276446227 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82.a426199c-cfaa-4ad0-a8e6-64f254c0b3c7 is being set with open permissions: ugo+rw Sep 10 20:05:05 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8e40a285-7aa9-4a26-bb68-f13e72149c7c tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82.a426199c-cfaa-4ad0-a8e6-64f254c0b3c7 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:05 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82.a426199c-cfaa-4ad0-a8e6-64f254c0b3c7 Sep 10 20:05:05 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:06 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8e40a285-7aa9-4a26-bb68-f13e72149c7c tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82.a426199c-cfaa-4ad0-a8e6-64f254c0b3c7" returned: 0 in 0.251s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8e40a285-7aa9-4a26-bb68-f13e72149c7c tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:06 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82.info Sep 10 20:05:06 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:06 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8e40a285-7aa9-4a26-bb68-f13e72149c7c tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82.info" returned: 0 in 0.252s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:06 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-8e40a285-7aa9-4a26-bb68-f13e72149c7c tempest-ProjectReaderTests-1276446227 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82.info is being set with open permissions: ugo+rw Sep 10 20:05:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8e40a285-7aa9-4a26-bb68-f13e72149c7c tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:06 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82.info Sep 10 20:05:06 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:06 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-8e40a285-7aa9-4a26-bb68-f13e72149c7c tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82.info" returned: 0 in 0.248s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:06 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-8e40a285-7aa9-4a26-bb68-f13e72149c7c tempest-ProjectReaderTests-1276446227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.906s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:06 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-8e40a285-7aa9-4a26-bb68-f13e72149c7c tempest-ProjectReaderTests-1276446227 None] Create snapshot completed successfully Sep 10 20:05:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2dfae14c-d282-4ee2-ae87-f90574f9f24b tempest-ProjectReaderTests-1276446227 None] Acquiring lock "cinder-a426199c-cfaa-4ad0-a8e6-64f254c0b3c7-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:05:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2dfae14c-d282-4ee2-ae87-f90574f9f24b tempest-ProjectReaderTests-1276446227 None] Lock "cinder-a426199c-cfaa-4ad0-a8e6-64f254c0b3c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:05:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2dfae14c-d282-4ee2-ae87-f90574f9f24b tempest-ProjectReaderTests-1276446227 None] Acquiring lock "cinder-quobyte-1a0f5799-d3fa-43a6-89de-f071bbe49d82" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:05:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2dfae14c-d282-4ee2-ae87-f90574f9f24b tempest-ProjectReaderTests-1276446227 None] Lock "cinder-quobyte-1a0f5799-d3fa-43a6-89de-f071bbe49d82" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:05:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2dfae14c-d282-4ee2-ae87-f90574f9f24b tempest-ProjectReaderTests-1276446227 None] Acquiring lock "cinder-quobyte-a426199c-cfaa-4ad0-a8e6-64f254c0b3c7" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:05:07 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2dfae14c-d282-4ee2-ae87-f90574f9f24b tempest-ProjectReaderTests-1276446227 None] Lock "cinder-quobyte-a426199c-cfaa-4ad0-a8e6-64f254c0b3c7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:05:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-2dfae14c-d282-4ee2-ae87-f90574f9f24b tempest-ProjectReaderTests-1276446227 None] Deleting offline snapshot a426199c-cfaa-4ad0-a8e6-64f254c0b3c7 of volume 1a0f5799-d3fa-43a6-89de-f071bbe49d82 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:05:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-2dfae14c-d282-4ee2-ae87-f90574f9f24b tempest-ProjectReaderTests-1276446227 None] snapshot_file for this snap is: volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82.a426199c-cfaa-4ad0-a8e6-64f254c0b3c7 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:05:07 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[088fd5cf-b065-48dd-b8ed-b278cea79318]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:05:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2dfae14c-d282-4ee2-ae87-f90574f9f24b tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82.a426199c-cfaa-4ad0-a8e6-64f254c0b3c7 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:07 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82.a426199c-cfaa-4ad0-a8e6-64f254c0b3c7 Sep 10 20:05:07 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:07 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2dfae14c-d282-4ee2-ae87-f90574f9f24b tempest-ProjectReaderTests-1276446227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82.a426199c-cfaa-4ad0-a8e6-64f254c0b3c7" returned: 0 in 0.375s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:07 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-2dfae14c-d282-4ee2-ae87-f90574f9f24b tempest-ProjectReaderTests-1276446227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:05:07 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c5eb68-364b-403a-ae5b-d7b795714e00]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:05:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2dfae14c-d282-4ee2-ae87-f90574f9f24b tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:07 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82 Sep 10 20:05:07 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:07 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2dfae14c-d282-4ee2-ae87-f90574f9f24b tempest-ProjectReaderTests-1276446227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82" returned: 0 in 0.361s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:07 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2dfae14c-d282-4ee2-ae87-f90574f9f24b tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82.a426199c-cfaa-4ad0-a8e6-64f254c0b3c7 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:07 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82.a426199c-cfaa-4ad0-a8e6-64f254c0b3c7 Sep 10 20:05:07 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:08 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2dfae14c-d282-4ee2-ae87-f90574f9f24b tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82.a426199c-cfaa-4ad0-a8e6-64f254c0b3c7" returned: 0 in 0.335s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2dfae14c-d282-4ee2-ae87-f90574f9f24b tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82.a426199c-cfaa-4ad0-a8e6-64f254c0b3c7 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:08 devstack sudo[108148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82.a426199c-cfaa-4ad0-a8e6-64f254c0b3c7 Sep 10 20:05:08 devstack sudo[108148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:08 devstack sudo[108148]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:08 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-2dfae14c-d282-4ee2-ae87-f90574f9f24b tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82.a426199c-cfaa-4ad0-a8e6-64f254c0b3c7" returned: 0 in 0.251s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2dfae14c-d282-4ee2-ae87-f90574f9f24b tempest-ProjectReaderTests-1276446227 None] Lock "cinder-quobyte-a426199c-cfaa-4ad0-a8e6-64f254c0b3c7" released by "_delete_snapshot" :: held 1.417s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:05:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2dfae14c-d282-4ee2-ae87-f90574f9f24b tempest-ProjectReaderTests-1276446227 None] Lock "cinder-quobyte-1a0f5799-d3fa-43a6-89de-f071bbe49d82" released by "delete_snapshot" :: held 1.442s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:05:08 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-2dfae14c-d282-4ee2-ae87-f90574f9f24b tempest-ProjectReaderTests-1276446227 None] Created reservations ['87e5324f-ebd4-41ce-9c7d-1a1490017a77', 'c9e94055-f1f1-46ab-85e5-a6ffb617d6b6', '49fc943f-f106-4a22-b248-ca29f9560e00', 'cae3685e-74bd-4b86-8a0c-0e44606bdc3c'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:05:08 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-2dfae14c-d282-4ee2-ae87-f90574f9f24b tempest-ProjectReaderTests-1276446227 None] Delete snapshot completed successfully. Sep 10 20:05:08 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-2dfae14c-d282-4ee2-ae87-f90574f9f24b tempest-ProjectReaderTests-1276446227 None] Lock "cinder-a426199c-cfaa-4ad0-a8e6-64f254c0b3c7-delete_snapshot" released by "delete_snapshot" :: held 1.604s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:05:09 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-86cff5a5-c252-4611-9f55-95ec233e73d0 tempest-ProjectReaderTests-1276446227 None] Acquiring lock "cinder-1a0f5799-d3fa-43a6-89de-f071bbe49d82-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:05:09 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-86cff5a5-c252-4611-9f55-95ec233e73d0 tempest-ProjectReaderTests-1276446227 None] Lock "cinder-1a0f5799-d3fa-43a6-89de-f071bbe49d82-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:05:09 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=109,cinder:INSERT=42,cinder:UPDATE=127,cinder:DELETE=9 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:05:09 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=100,cinder:INSERT=33,cinder:UPDATE=139,cinder:DELETE=13 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:05:09 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-86cff5a5-c252-4611-9f55-95ec233e73d0 tempest-ProjectReaderTests-1276446227 None] Acquiring lock "cinder-quobyte-1a0f5799-d3fa-43a6-89de-f071bbe49d82" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:05:09 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-86cff5a5-c252-4611-9f55-95ec233e73d0 tempest-ProjectReaderTests-1276446227 None] Lock "cinder-quobyte-1a0f5799-d3fa-43a6-89de-f071bbe49d82" acquired by "delete_volume" :: waited 0.017s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:05:09 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[0194a217-8ab7-449f-95ce-45126e23bf17]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:05:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-86cff5a5-c252-4611-9f55-95ec233e73d0 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:09 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82 Sep 10 20:05:09 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:09 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-86cff5a5-c252-4611-9f55-95ec233e73d0 tempest-ProjectReaderTests-1276446227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82" returned: 0 in 0.415s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:09 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-86cff5a5-c252-4611-9f55-95ec233e73d0 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:09 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82 Sep 10 20:05:09 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:09 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-86cff5a5-c252-4611-9f55-95ec233e73d0 tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-1a0f5799-d3fa-43a6-89de-f071bbe49d82" returned: 0 in 0.266s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-86cff5a5-c252-4611-9f55-95ec233e73d0 tempest-ProjectReaderTests-1276446227 None] Lock "cinder-quobyte-1a0f5799-d3fa-43a6-89de-f071bbe49d82" released by "delete_volume" :: held 0.749s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-86cff5a5-c252-4611-9f55-95ec233e73d0 tempest-ProjectReaderTests-1276446227 None] Created reservations ['7d6c2c81-b1b8-4219-8f63-64259501e57b', '789fe7b3-4683-4e19-8266-bee125a966e6', 'd674a05e-fec2-4497-8bc8-2c124fbc5bfe', '5377673f-57bd-4dee-bb73-c1102327f241'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-86cff5a5-c252-4611-9f55-95ec233e73d0 tempest-ProjectReaderTests-1276446227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-86cff5a5-c252-4611-9f55-95ec233e73d0 tempest-ProjectReaderTests-1276446227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-86cff5a5-c252-4611-9f55-95ec233e73d0 tempest-ProjectReaderTests-1276446227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-86cff5a5-c252-4611-9f55-95ec233e73d0 tempest-ProjectReaderTests-1276446227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-86cff5a5-c252-4611-9f55-95ec233e73d0 tempest-ProjectReaderTests-1276446227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-86cff5a5-c252-4611-9f55-95ec233e73d0 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:10 devstack sudo[108160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:05:10 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:10 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-86cff5a5-c252-4611-9f55-95ec233e73d0 tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.288s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-86cff5a5-c252-4611-9f55-95ec233e73d0 tempest-ProjectReaderTests-1276446227 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:05:10 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-86cff5a5-c252-4611-9f55-95ec233e73d0 tempest-ProjectReaderTests-1276446227 None] Deleted volume successfully. Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-86cff5a5-c252-4611-9f55-95ec233e73d0 tempest-ProjectReaderTests-1276446227 None] Lock "cinder-1a0f5799-d3fa-43a6-89de-f071bbe49d82-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] Flow 'volume_create_manager' (57eadd52-05c0-4980-88ce-3d87007f60a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3896e84b-8af9-4d6f-9e3a-65920b669eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3896e84b-8af9-4d6f-9e3a-65920b669eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1876176622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e62edfd-3edd-4cfc-9098-51f6018c3e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d4bc2bbaad4058afe49e04653c5424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:05:11Z,use_quota=True,user_id='cd4ba87cb23341159e973c8c4d98d141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58901206-f1f9-4c0f-ae0e-048e284fc173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58901206-f1f9-4c0f-ae0e-048e284fc173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f736d04-2718-4bc6-bc27-4c2852984749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f736d04-2718-4bc6-bc27-4c2852984749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e62edfd-3edd-4cfc-9098-51f6018c3e04', 'volume_name': 'volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5c4877-e076-4fc9-af0b-cebd0c024132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5c4877-e076-4fc9-af0b-cebd0c024132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (661e6c4d-1d4d-46ac-b094-e4a7075d3e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:10 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] Volume 3e62edfd-3edd-4cfc-9098-51f6018c3e04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04', 'volume_size': 1} Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1876176622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e62edfd-3edd-4cfc-9098-51f6018c3e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d4bc2bbaad4058afe49e04653c5424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:05:11Z,use_quota=True,user_id='cd4ba87cb23341159e973c8c4d98d141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] Creating volume 3e62edfd-3edd-4cfc-9098-51f6018c3e04 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:05:10 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:05:10 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:11 devstack sudo[108163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04 1073741824 Sep 10 20:05:11 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:11 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04 1073741824" returned: 0 in 0.421s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:11 devstack sudo[108168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04 Sep 10 20:05:11 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:11 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04" returned: 0 in 0.268s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:11 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:05:11 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (661e6c4d-1d4d-46ac-b094-e4a7075d3e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9814726-61bb-4266-bcd0-a6ec9b928ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:11 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] Volume volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04 (3e62edfd-3edd-4cfc-9098-51f6018c3e04): created successfully Sep 10 20:05:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9814726-61bb-4266-bcd0-a6ec9b928ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:11 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] Flow 'volume_create_manager' (57eadd52-05c0-4980-88ce-3d87007f60a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:05:11 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-fda09407-46d2-4868-859f-8348cf2e3c3c tempest-ProjectReaderTests-1276446227 None] Created volume successfully. Sep 10 20:05:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-418bbc11-aa28-4d01-9cef-5607da6668fe tempest-ProjectReaderTests-1276446227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-418bbc11-aa28-4d01-9cef-5607da6668fe tempest-ProjectReaderTests-1276446227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:12 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-418bbc11-aa28-4d01-9cef-5607da6668fe tempest-ProjectReaderTests-1276446227 None] Creating offline snapshot 54af83f5-f129-4e25-8865-f5818bbd0acb of volume 3e62edfd-3edd-4cfc-9098-51f6018c3e04 {{(pid=88093) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:05:12 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[717044b3-df7f-41d0-b107-012fc082bd58]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:05:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-418bbc11-aa28-4d01-9cef-5607da6668fe tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:12 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04 Sep 10 20:05:12 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:12 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-418bbc11-aa28-4d01-9cef-5607da6668fe tempest-ProjectReaderTests-1276446227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04" returned: 0 in 0.347s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-418bbc11-aa28-4d01-9cef-5607da6668fe tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04.54af83f5-f129-4e25-8865-f5818bbd0acb 1G {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:12 devstack sudo[108178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04.54af83f5-f129-4e25-8865-f5818bbd0acb 1G Sep 10 20:05:12 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:12 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-418bbc11-aa28-4d01-9cef-5607da6668fe tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04.54af83f5-f129-4e25-8865-f5818bbd0acb 1G" returned: 0 in 0.379s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:12 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-418bbc11-aa28-4d01-9cef-5607da6668fe tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04.54af83f5-f129-4e25-8865-f5818bbd0acb {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:12 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04.54af83f5-f129-4e25-8865-f5818bbd0acb Sep 10 20:05:12 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:13 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-418bbc11-aa28-4d01-9cef-5607da6668fe tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04 -F qcow2 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04.54af83f5-f129-4e25-8865-f5818bbd0acb" returned: 0 in 0.299s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:13 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-418bbc11-aa28-4d01-9cef-5607da6668fe tempest-ProjectReaderTests-1276446227 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04.54af83f5-f129-4e25-8865-f5818bbd0acb is being set with open permissions: ugo+rw Sep 10 20:05:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-418bbc11-aa28-4d01-9cef-5607da6668fe tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04.54af83f5-f129-4e25-8865-f5818bbd0acb {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:13 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04.54af83f5-f129-4e25-8865-f5818bbd0acb Sep 10 20:05:13 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:13 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-418bbc11-aa28-4d01-9cef-5607da6668fe tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04.54af83f5-f129-4e25-8865-f5818bbd0acb" returned: 0 in 0.254s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-418bbc11-aa28-4d01-9cef-5607da6668fe tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:13 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04.info Sep 10 20:05:13 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:13 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-418bbc11-aa28-4d01-9cef-5607da6668fe tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04.info" returned: 0 in 0.256s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:13 devstack cinder-volume[88093]: WARNING cinder.volume.drivers.remotefs [None req-418bbc11-aa28-4d01-9cef-5607da6668fe tempest-ProjectReaderTests-1276446227 None] /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04.info is being set with open permissions: ugo+rw Sep 10 20:05:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-418bbc11-aa28-4d01-9cef-5607da6668fe tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04.info {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:13 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04.info Sep 10 20:05:13 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:13 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-418bbc11-aa28-4d01-9cef-5607da6668fe tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04.info" returned: 0 in 0.248s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-418bbc11-aa28-4d01-9cef-5607da6668fe tempest-ProjectReaderTests-1276446227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.862s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:13 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-418bbc11-aa28-4d01-9cef-5607da6668fe tempest-ProjectReaderTests-1276446227 None] Create snapshot completed successfully Sep 10 20:05:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-09ffa457-1612-4b19-a718-ccc0fa84497d tempest-ProjectReaderTests-1276446227 None] Acquiring lock "cinder-54af83f5-f129-4e25-8865-f5818bbd0acb-delete_snapshot" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:05:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-09ffa457-1612-4b19-a718-ccc0fa84497d tempest-ProjectReaderTests-1276446227 None] Lock "cinder-54af83f5-f129-4e25-8865-f5818bbd0acb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:05:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-09ffa457-1612-4b19-a718-ccc0fa84497d tempest-ProjectReaderTests-1276446227 None] Acquiring lock "cinder-quobyte-3e62edfd-3edd-4cfc-9098-51f6018c3e04" by "delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:05:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-09ffa457-1612-4b19-a718-ccc0fa84497d tempest-ProjectReaderTests-1276446227 None] Lock "cinder-quobyte-3e62edfd-3edd-4cfc-9098-51f6018c3e04" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:05:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-09ffa457-1612-4b19-a718-ccc0fa84497d tempest-ProjectReaderTests-1276446227 None] Acquiring lock "cinder-quobyte-54af83f5-f129-4e25-8865-f5818bbd0acb" by "_delete_snapshot" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:05:14 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-09ffa457-1612-4b19-a718-ccc0fa84497d tempest-ProjectReaderTests-1276446227 None] Lock "cinder-quobyte-54af83f5-f129-4e25-8865-f5818bbd0acb" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:05:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-09ffa457-1612-4b19-a718-ccc0fa84497d tempest-ProjectReaderTests-1276446227 None] Deleting offline snapshot 54af83f5-f129-4e25-8865-f5818bbd0acb of volume 3e62edfd-3edd-4cfc-9098-51f6018c3e04 {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:05:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-09ffa457-1612-4b19-a718-ccc0fa84497d tempest-ProjectReaderTests-1276446227 None] snapshot_file for this snap is: volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04.54af83f5-f129-4e25-8865-f5818bbd0acb {{(pid=88093) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:05:14 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd33984-5e93-44c0-9142-e1aca7aea63f]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:05:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-09ffa457-1612-4b19-a718-ccc0fa84497d tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04.54af83f5-f129-4e25-8865-f5818bbd0acb {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:14 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04.54af83f5-f129-4e25-8865-f5818bbd0acb Sep 10 20:05:14 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:14 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-09ffa457-1612-4b19-a718-ccc0fa84497d tempest-ProjectReaderTests-1276446227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04.54af83f5-f129-4e25-8865-f5818bbd0acb" returned: 0 in 0.397s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:14 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-09ffa457-1612-4b19-a718-ccc0fa84497d tempest-ProjectReaderTests-1276446227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88093) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:05:14 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[384842ee-94ff-45cc-8640-5aabd4d69f05]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:05:14 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-09ffa457-1612-4b19-a718-ccc0fa84497d tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:14 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04 Sep 10 20:05:14 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:15 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-09ffa457-1612-4b19-a718-ccc0fa84497d tempest-ProjectReaderTests-1276446227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04" returned: 0 in 0.373s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-09ffa457-1612-4b19-a718-ccc0fa84497d tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04.54af83f5-f129-4e25-8865-f5818bbd0acb {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:15 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04.54af83f5-f129-4e25-8865-f5818bbd0acb Sep 10 20:05:15 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:15 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-09ffa457-1612-4b19-a718-ccc0fa84497d tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04.54af83f5-f129-4e25-8865-f5818bbd0acb" returned: 0 in 0.341s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-09ffa457-1612-4b19-a718-ccc0fa84497d tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04.54af83f5-f129-4e25-8865-f5818bbd0acb {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:15 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04.54af83f5-f129-4e25-8865-f5818bbd0acb Sep 10 20:05:15 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:15 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:15 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-09ffa457-1612-4b19-a718-ccc0fa84497d tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04.54af83f5-f129-4e25-8865-f5818bbd0acb" returned: 0 in 0.256s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-09ffa457-1612-4b19-a718-ccc0fa84497d tempest-ProjectReaderTests-1276446227 None] Lock "cinder-quobyte-54af83f5-f129-4e25-8865-f5818bbd0acb" released by "_delete_snapshot" :: held 1.462s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:05:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-09ffa457-1612-4b19-a718-ccc0fa84497d tempest-ProjectReaderTests-1276446227 None] Lock "cinder-quobyte-3e62edfd-3edd-4cfc-9098-51f6018c3e04" released by "delete_snapshot" :: held 1.490s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:05:15 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-09ffa457-1612-4b19-a718-ccc0fa84497d tempest-ProjectReaderTests-1276446227 None] Created reservations ['8bdb4e19-ab1d-418e-a96c-60ef883f7dea', 'a82a7c62-01b6-4e09-baec-72f351a94f92', '98c1db3b-5aa8-4992-b9d9-453fc49886e3', 'b495df77-9ae7-4358-906d-d5b137235b93'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:05:15 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-09ffa457-1612-4b19-a718-ccc0fa84497d tempest-ProjectReaderTests-1276446227 None] Delete snapshot completed successfully. Sep 10 20:05:15 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-09ffa457-1612-4b19-a718-ccc0fa84497d tempest-ProjectReaderTests-1276446227 None] Lock "cinder-54af83f5-f129-4e25-8865-f5818bbd0acb-delete_snapshot" released by "delete_snapshot" :: held 1.626s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:05:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5f5fbc5c-beb6-4fbc-afd8-264901b91557 tempest-ProjectReaderTests-1276446227 None] Acquiring lock "cinder-3e62edfd-3edd-4cfc-9098-51f6018c3e04-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:05:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5f5fbc5c-beb6-4fbc-afd8-264901b91557 tempest-ProjectReaderTests-1276446227 None] Lock "cinder-3e62edfd-3edd-4cfc-9098-51f6018c3e04-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:05:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5f5fbc5c-beb6-4fbc-afd8-264901b91557 tempest-ProjectReaderTests-1276446227 None] Acquiring lock "cinder-quobyte-3e62edfd-3edd-4cfc-9098-51f6018c3e04" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:05:16 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5f5fbc5c-beb6-4fbc-afd8-264901b91557 tempest-ProjectReaderTests-1276446227 None] Lock "cinder-quobyte-3e62edfd-3edd-4cfc-9098-51f6018c3e04" acquired by "delete_volume" :: waited 0.017s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:05:16 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[660ff9e0-918e-4770-95e7-e784f27aa2c9]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:05:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5f5fbc5c-beb6-4fbc-afd8-264901b91557 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:16 devstack sudo[108216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04 Sep 10 20:05:16 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:16 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5f5fbc5c-beb6-4fbc-afd8-264901b91557 tempest-ProjectReaderTests-1276446227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04" returned: 0 in 0.379s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:16 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5f5fbc5c-beb6-4fbc-afd8-264901b91557 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:16 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04 Sep 10 20:05:16 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:17 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5f5fbc5c-beb6-4fbc-afd8-264901b91557 tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-3e62edfd-3edd-4cfc-9098-51f6018c3e04" returned: 0 in 0.265s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:17 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5f5fbc5c-beb6-4fbc-afd8-264901b91557 tempest-ProjectReaderTests-1276446227 None] Lock "cinder-quobyte-3e62edfd-3edd-4cfc-9098-51f6018c3e04" released by "delete_volume" :: held 0.702s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:05:17 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-5f5fbc5c-beb6-4fbc-afd8-264901b91557 tempest-ProjectReaderTests-1276446227 None] Created reservations ['859d5665-a910-4316-9f10-298579c684e5', '8fe197bb-795b-44f6-b749-67d607d57a6d', '4fb30d52-4bff-480d-bfce-39c7ac6d2234', 'd28042f0-1948-439a-8c14-0dd45af1cc26'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:05:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5f5fbc5c-beb6-4fbc-afd8-264901b91557 tempest-ProjectReaderTests-1276446227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5f5fbc5c-beb6-4fbc-afd8-264901b91557 tempest-ProjectReaderTests-1276446227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:17 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5f5fbc5c-beb6-4fbc-afd8-264901b91557 tempest-ProjectReaderTests-1276446227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:05:17 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5f5fbc5c-beb6-4fbc-afd8-264901b91557 tempest-ProjectReaderTests-1276446227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:05:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5f5fbc5c-beb6-4fbc-afd8-264901b91557 tempest-ProjectReaderTests-1276446227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5f5fbc5c-beb6-4fbc-afd8-264901b91557 tempest-ProjectReaderTests-1276446227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:17 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:05:17 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:17 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:17 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5f5fbc5c-beb6-4fbc-afd8-264901b91557 tempest-ProjectReaderTests-1276446227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.251s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:17 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-5f5fbc5c-beb6-4fbc-afd8-264901b91557 tempest-ProjectReaderTests-1276446227 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:05:17 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-5f5fbc5c-beb6-4fbc-afd8-264901b91557 tempest-ProjectReaderTests-1276446227 None] Deleted volume successfully. Sep 10 20:05:17 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5f5fbc5c-beb6-4fbc-afd8-264901b91557 tempest-ProjectReaderTests-1276446227 None] Lock "cinder-3e62edfd-3edd-4cfc-9098-51f6018c3e04-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:05:27 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=17,cinder:INSERT=7,cinder:UPDATE=28,cinder:DELETE=2 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:05:27 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=20,cinder:INSERT=7,cinder:UPDATE=23,cinder:DELETE=2 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:05:34 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:05:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] Flow 'volume_create_manager' (626d74bb-2d20-430e-912b-ee333353ea32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:05:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce58bef4-c521-4e74-9871-a14e4840cb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce58bef4-c521-4e74-9871-a14e4840cb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-844792969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2250b69d-c429-4e79-abb1-c1bc5cc4a217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c6b523d66d4dd7a4ff52cab9414e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:05:35Z,use_quota=True,user_id='2fa24792cea4402fa4d0236b3d4ecf07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca6a2d2-cdf6-460d-8743-7567791ba6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca6a2d2-cdf6-460d-8743-7567791ba6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf88597-8e37-445f-af05-073681c372fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf88597-8e37-445f-af05-073681c372fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2250b69d-c429-4e79-abb1-c1bc5cc4a217', 'volume_name': 'volume-2250b69d-c429-4e79-abb1-c1bc5cc4a217', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0daca6b8-0e7f-45a9-ba81-ffe48bd02a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0daca6b8-0e7f-45a9-ba81-ffe48bd02a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:34 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490a4c3d-d1dc-4059-a549-eafaf7a4b60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:34 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] Volume 2250b69d-c429-4e79-abb1-c1bc5cc4a217: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2250b69d-c429-4e79-abb1-c1bc5cc4a217', 'volume_size': 1} Sep 10 20:05:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:34 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-844792969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2250b69d-c429-4e79-abb1-c1bc5cc4a217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c6b523d66d4dd7a4ff52cab9414e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:05:35Z,use_quota=True,user_id='2fa24792cea4402fa4d0236b3d4ecf07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:05:34 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] Creating volume 2250b69d-c429-4e79-abb1-c1bc5cc4a217 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:05:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:34 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:05:34 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:05:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:34 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:05:34 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:05:34 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2250b69d-c429-4e79-abb1-c1bc5cc4a217 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:34 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2250b69d-c429-4e79-abb1-c1bc5cc4a217 1073741824 Sep 10 20:05:34 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:35 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2250b69d-c429-4e79-abb1-c1bc5cc4a217 1073741824" returned: 0 in 0.426s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2250b69d-c429-4e79-abb1-c1bc5cc4a217 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:35 devstack sudo[108238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2250b69d-c429-4e79-abb1-c1bc5cc4a217 Sep 10 20:05:35 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:35 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2250b69d-c429-4e79-abb1-c1bc5cc4a217" returned: 0 in 0.270s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:35 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:05:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490a4c3d-d1dc-4059-a549-eafaf7a4b60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2250b69d-c429-4e79-abb1-c1bc5cc4a217', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2445ddaf-a8d5-4c98-b41e-3b293a0cc030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:35 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] Volume volume-2250b69d-c429-4e79-abb1-c1bc5cc4a217 (2250b69d-c429-4e79-abb1-c1bc5cc4a217): created successfully Sep 10 20:05:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2445ddaf-a8d5-4c98-b41e-3b293a0cc030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:35 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] Flow 'volume_create_manager' (626d74bb-2d20-430e-912b-ee333353ea32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:05:35 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-e6f886ee-e85f-48af-999a-b481cc6a5ed0 tempest-ProjectReaderTests-173975595 None] Created volume successfully. Sep 10 20:05:35 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0100db4a-cbed-44b1-944c-4e15734eef2c tempest-ProjectReaderTests-173975595 None] Acquiring lock "cinder-2250b69d-c429-4e79-abb1-c1bc5cc4a217-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:05:35 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0100db4a-cbed-44b1-944c-4e15734eef2c tempest-ProjectReaderTests-173975595 None] Lock "cinder-2250b69d-c429-4e79-abb1-c1bc5cc4a217-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:05:35 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0100db4a-cbed-44b1-944c-4e15734eef2c tempest-ProjectReaderTests-173975595 None] Acquiring lock "cinder-quobyte-2250b69d-c429-4e79-abb1-c1bc5cc4a217" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:05:35 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0100db4a-cbed-44b1-944c-4e15734eef2c tempest-ProjectReaderTests-173975595 None] Lock "cinder-quobyte-2250b69d-c429-4e79-abb1-c1bc5cc4a217" acquired by "delete_volume" :: waited 0.017s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:05:35 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79845a2-a06d-43b1-9fe6-7a48661ba730]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:05:35 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0100db4a-cbed-44b1-944c-4e15734eef2c tempest-ProjectReaderTests-173975595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2250b69d-c429-4e79-abb1-c1bc5cc4a217 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:35 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2250b69d-c429-4e79-abb1-c1bc5cc4a217 Sep 10 20:05:35 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:36 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0100db4a-cbed-44b1-944c-4e15734eef2c tempest-ProjectReaderTests-173975595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2250b69d-c429-4e79-abb1-c1bc5cc4a217" returned: 0 in 0.375s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0100db4a-cbed-44b1-944c-4e15734eef2c tempest-ProjectReaderTests-173975595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2250b69d-c429-4e79-abb1-c1bc5cc4a217 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:36 devstack sudo[108246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2250b69d-c429-4e79-abb1-c1bc5cc4a217 Sep 10 20:05:36 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:36 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0100db4a-cbed-44b1-944c-4e15734eef2c tempest-ProjectReaderTests-173975595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-2250b69d-c429-4e79-abb1-c1bc5cc4a217" returned: 0 in 0.280s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:36 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0100db4a-cbed-44b1-944c-4e15734eef2c tempest-ProjectReaderTests-173975595 None] Lock "cinder-quobyte-2250b69d-c429-4e79-abb1-c1bc5cc4a217" released by "delete_volume" :: held 0.694s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:05:36 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-0100db4a-cbed-44b1-944c-4e15734eef2c tempest-ProjectReaderTests-173975595 None] Created reservations ['40875d27-3416-4077-8d38-e1e23ebdbca0', '636d3138-1824-49cd-8122-9c6cd8779b3c', '04e48072-197b-4396-b624-1ebcea8dc665', '63b145f2-f4e0-442e-95de-3212b447c05d'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:05:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0100db4a-cbed-44b1-944c-4e15734eef2c tempest-ProjectReaderTests-173975595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0100db4a-cbed-44b1-944c-4e15734eef2c tempest-ProjectReaderTests-173975595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:36 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0100db4a-cbed-44b1-944c-4e15734eef2c tempest-ProjectReaderTests-173975595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:05:36 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-0100db4a-cbed-44b1-944c-4e15734eef2c tempest-ProjectReaderTests-173975595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:05:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-0100db4a-cbed-44b1-944c-4e15734eef2c tempest-ProjectReaderTests-173975595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0100db4a-cbed-44b1-944c-4e15734eef2c tempest-ProjectReaderTests-173975595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:36 devstack sudo[108249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:05:36 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:36 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:36 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-0100db4a-cbed-44b1-944c-4e15734eef2c tempest-ProjectReaderTests-173975595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.261s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:36 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-0100db4a-cbed-44b1-944c-4e15734eef2c tempest-ProjectReaderTests-173975595 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:05:36 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-0100db4a-cbed-44b1-944c-4e15734eef2c tempest-ProjectReaderTests-173975595 None] Deleted volume successfully. Sep 10 20:05:37 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-0100db4a-cbed-44b1-944c-4e15734eef2c tempest-ProjectReaderTests-173975595 None] Lock "cinder-2250b69d-c429-4e79-abb1-c1bc5cc4a217-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:05:37 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:05:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] Flow 'volume_create_manager' (1658bd25-6c5b-4c9a-a308-3fc76f692fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:05:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aae3d826-c0c5-43dc-a223-bfefaebaca0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aae3d826-c0c5-43dc-a223-bfefaebaca0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-563835483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=100121b0-7a63-4588-a2b8-df0eeda3399a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c6b523d66d4dd7a4ff52cab9414e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:05:37Z,use_quota=True,user_id='2fa24792cea4402fa4d0236b3d4ecf07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aceaa6d1-045b-4b72-a4bf-f324a5e6e122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aceaa6d1-045b-4b72-a4bf-f324a5e6e122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b83c65c4-c923-485c-b816-cb0689adc7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b83c65c4-c923-485c-b816-cb0689adc7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '100121b0-7a63-4588-a2b8-df0eeda3399a', 'volume_name': 'volume-100121b0-7a63-4588-a2b8-df0eeda3399a', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d822323a-701f-4c99-aeec-b003f8c3b625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d822323a-701f-4c99-aeec-b003f8c3b625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:37 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a2f9d96-2b2c-4d25-9fed-d26c5c510c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:37 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] Volume 100121b0-7a63-4588-a2b8-df0eeda3399a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-100121b0-7a63-4588-a2b8-df0eeda3399a', 'volume_size': 1} Sep 10 20:05:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:37 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-563835483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=100121b0-7a63-4588-a2b8-df0eeda3399a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c6b523d66d4dd7a4ff52cab9414e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:05:37Z,use_quota=True,user_id='2fa24792cea4402fa4d0236b3d4ecf07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:05:37 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] Creating volume 100121b0-7a63-4588-a2b8-df0eeda3399a {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:05:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:37 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:05:37 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:05:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:37 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:05:37 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:05:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-100121b0-7a63-4588-a2b8-df0eeda3399a 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:37 devstack sudo[108252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-100121b0-7a63-4588-a2b8-df0eeda3399a 1073741824 Sep 10 20:05:37 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:37 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-100121b0-7a63-4588-a2b8-df0eeda3399a 1073741824" returned: 0 in 0.419s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:37 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-100121b0-7a63-4588-a2b8-df0eeda3399a {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:37 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-100121b0-7a63-4588-a2b8-df0eeda3399a Sep 10 20:05:37 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:38 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-100121b0-7a63-4588-a2b8-df0eeda3399a" returned: 0 in 0.235s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:38 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:05:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a2f9d96-2b2c-4d25-9fed-d26c5c510c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-100121b0-7a63-4588-a2b8-df0eeda3399a', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d26a3d67-f6d4-4188-9540-b12aafb4bf0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:38 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] Volume volume-100121b0-7a63-4588-a2b8-df0eeda3399a (100121b0-7a63-4588-a2b8-df0eeda3399a): created successfully Sep 10 20:05:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d26a3d67-f6d4-4188-9540-b12aafb4bf0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:38 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] Flow 'volume_create_manager' (1658bd25-6c5b-4c9a-a308-3fc76f692fbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:05:38 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-3a9486a9-c924-41c9-bc8c-23381eaecf25 tempest-ProjectReaderTests-173975595 None] Created volume successfully. Sep 10 20:05:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5613a8e3-3289-430e-9552-540f2d82e001 tempest-ProjectReaderTests-173975595 None] Acquiring lock "cinder-100121b0-7a63-4588-a2b8-df0eeda3399a-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:05:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5613a8e3-3289-430e-9552-540f2d82e001 tempest-ProjectReaderTests-173975595 None] Lock "cinder-100121b0-7a63-4588-a2b8-df0eeda3399a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:05:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5613a8e3-3289-430e-9552-540f2d82e001 tempest-ProjectReaderTests-173975595 None] Acquiring lock "cinder-quobyte-100121b0-7a63-4588-a2b8-df0eeda3399a" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:05:38 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5613a8e3-3289-430e-9552-540f2d82e001 tempest-ProjectReaderTests-173975595 None] Lock "cinder-quobyte-100121b0-7a63-4588-a2b8-df0eeda3399a" acquired by "delete_volume" :: waited 0.018s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:05:38 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[358a6b2e-7107-4534-ae94-3b9c5e80f1db]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:05:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5613a8e3-3289-430e-9552-540f2d82e001 tempest-ProjectReaderTests-173975595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-100121b0-7a63-4588-a2b8-df0eeda3399a {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:38 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-100121b0-7a63-4588-a2b8-df0eeda3399a Sep 10 20:05:38 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:38 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5613a8e3-3289-430e-9552-540f2d82e001 tempest-ProjectReaderTests-173975595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-100121b0-7a63-4588-a2b8-df0eeda3399a" returned: 0 in 0.353s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:38 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5613a8e3-3289-430e-9552-540f2d82e001 tempest-ProjectReaderTests-173975595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-100121b0-7a63-4588-a2b8-df0eeda3399a {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:38 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-100121b0-7a63-4588-a2b8-df0eeda3399a Sep 10 20:05:38 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:39 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5613a8e3-3289-430e-9552-540f2d82e001 tempest-ProjectReaderTests-173975595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-100121b0-7a63-4588-a2b8-df0eeda3399a" returned: 0 in 0.253s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:39 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5613a8e3-3289-430e-9552-540f2d82e001 tempest-ProjectReaderTests-173975595 None] Lock "cinder-quobyte-100121b0-7a63-4588-a2b8-df0eeda3399a" released by "delete_volume" :: held 0.652s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:05:39 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-5613a8e3-3289-430e-9552-540f2d82e001 tempest-ProjectReaderTests-173975595 None] Created reservations ['864c37c4-2e2e-4407-a3dc-dcace9744552', 'f95929ca-3991-45a3-ac69-d3594781131d', 'bb275246-46cc-4ef5-a0bc-f82b32aa04c0', 'da845f28-cf91-48bc-b625-638ba1995e40'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:05:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5613a8e3-3289-430e-9552-540f2d82e001 tempest-ProjectReaderTests-173975595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5613a8e3-3289-430e-9552-540f2d82e001 tempest-ProjectReaderTests-173975595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:39 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5613a8e3-3289-430e-9552-540f2d82e001 tempest-ProjectReaderTests-173975595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:05:39 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-5613a8e3-3289-430e-9552-540f2d82e001 tempest-ProjectReaderTests-173975595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:05:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-5613a8e3-3289-430e-9552-540f2d82e001 tempest-ProjectReaderTests-173975595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5613a8e3-3289-430e-9552-540f2d82e001 tempest-ProjectReaderTests-173975595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:39 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:05:39 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:39 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:39 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-5613a8e3-3289-430e-9552-540f2d82e001 tempest-ProjectReaderTests-173975595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.273s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:39 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-5613a8e3-3289-430e-9552-540f2d82e001 tempest-ProjectReaderTests-173975595 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:05:39 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-5613a8e3-3289-430e-9552-540f2d82e001 tempest-ProjectReaderTests-173975595 None] Deleted volume successfully. Sep 10 20:05:39 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-5613a8e3-3289-430e-9552-540f2d82e001 tempest-ProjectReaderTests-173975595 None] Lock "cinder-100121b0-7a63-4588-a2b8-df0eeda3399a-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:05:40 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:05:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] Flow 'volume_create_manager' (a5fe1019-de4f-4b3b-a1db-091112e62301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:05:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b4cef0-0de4-49bd-949a-42f41eddd219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b4cef0-0de4-49bd-949a-42f41eddd219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1788506061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c452b391-981a-4515-91f9-68b3982f2cea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c6b523d66d4dd7a4ff52cab9414e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:05:40Z,use_quota=True,user_id='2fa24792cea4402fa4d0236b3d4ecf07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ffe011-3822-4cc9-8c28-e24fb2d2171e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ffe011-3822-4cc9-8c28-e24fb2d2171e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5804bdb1-857e-401e-ac28-e39d12986ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5804bdb1-857e-401e-ac28-e39d12986ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c452b391-981a-4515-91f9-68b3982f2cea', 'volume_name': 'volume-c452b391-981a-4515-91f9-68b3982f2cea', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd4384b-f1ac-4c9f-ad30-7c7da6ef4bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd4384b-f1ac-4c9f-ad30-7c7da6ef4bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (234098fe-5002-4236-9f0e-ef1ba7220d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:40 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] Volume c452b391-981a-4515-91f9-68b3982f2cea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c452b391-981a-4515-91f9-68b3982f2cea', 'volume_size': 1} Sep 10 20:05:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1788506061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c452b391-981a-4515-91f9-68b3982f2cea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c6b523d66d4dd7a4ff52cab9414e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:05:40Z,use_quota=True,user_id='2fa24792cea4402fa4d0236b3d4ecf07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:05:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] Creating volume c452b391-981a-4515-91f9-68b3982f2cea {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:05:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:05:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:05:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:05:40 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:05:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c452b391-981a-4515-91f9-68b3982f2cea 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:40 devstack sudo[108308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c452b391-981a-4515-91f9-68b3982f2cea 1073741824 Sep 10 20:05:40 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:40 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c452b391-981a-4515-91f9-68b3982f2cea 1073741824" returned: 0 in 0.433s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c452b391-981a-4515-91f9-68b3982f2cea {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:40 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c452b391-981a-4515-91f9-68b3982f2cea Sep 10 20:05:40 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:40 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c452b391-981a-4515-91f9-68b3982f2cea" returned: 0 in 0.236s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:40 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:05:40 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (234098fe-5002-4236-9f0e-ef1ba7220d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c452b391-981a-4515-91f9-68b3982f2cea', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (febe7bc7-03f4-4a11-b0b1-da469c9f20d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:40 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] Volume volume-c452b391-981a-4515-91f9-68b3982f2cea (c452b391-981a-4515-91f9-68b3982f2cea): created successfully Sep 10 20:05:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (febe7bc7-03f4-4a11-b0b1-da469c9f20d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:40 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] Flow 'volume_create_manager' (a5fe1019-de4f-4b3b-a1db-091112e62301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:05:40 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-40661930-2a17-4788-b476-221fe81d08bf tempest-ProjectReaderTests-173975595 None] Created volume successfully. Sep 10 20:05:41 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7ccff5cc-05e9-4cd0-8119-41f332ccc402 tempest-ProjectReaderTests-173975595 None] Acquiring lock "cinder-c452b391-981a-4515-91f9-68b3982f2cea-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:05:41 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7ccff5cc-05e9-4cd0-8119-41f332ccc402 tempest-ProjectReaderTests-173975595 None] Lock "cinder-c452b391-981a-4515-91f9-68b3982f2cea-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:05:41 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7ccff5cc-05e9-4cd0-8119-41f332ccc402 tempest-ProjectReaderTests-173975595 None] Acquiring lock "cinder-quobyte-c452b391-981a-4515-91f9-68b3982f2cea" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:05:41 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7ccff5cc-05e9-4cd0-8119-41f332ccc402 tempest-ProjectReaderTests-173975595 None] Lock "cinder-quobyte-c452b391-981a-4515-91f9-68b3982f2cea" acquired by "delete_volume" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:05:41 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3db897e-3797-4581-95e5-b2ac0532dc72]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:05:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7ccff5cc-05e9-4cd0-8119-41f332ccc402 tempest-ProjectReaderTests-173975595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c452b391-981a-4515-91f9-68b3982f2cea {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:41 devstack sudo[108317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c452b391-981a-4515-91f9-68b3982f2cea Sep 10 20:05:41 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:41 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7ccff5cc-05e9-4cd0-8119-41f332ccc402 tempest-ProjectReaderTests-173975595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c452b391-981a-4515-91f9-68b3982f2cea" returned: 0 in 0.362s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7ccff5cc-05e9-4cd0-8119-41f332ccc402 tempest-ProjectReaderTests-173975595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c452b391-981a-4515-91f9-68b3982f2cea {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:41 devstack sudo[108322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c452b391-981a-4515-91f9-68b3982f2cea Sep 10 20:05:41 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:41 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:41 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7ccff5cc-05e9-4cd0-8119-41f332ccc402 tempest-ProjectReaderTests-173975595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-c452b391-981a-4515-91f9-68b3982f2cea" returned: 0 in 0.244s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:41 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7ccff5cc-05e9-4cd0-8119-41f332ccc402 tempest-ProjectReaderTests-173975595 None] Lock "cinder-quobyte-c452b391-981a-4515-91f9-68b3982f2cea" released by "delete_volume" :: held 0.650s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:05:41 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-7ccff5cc-05e9-4cd0-8119-41f332ccc402 tempest-ProjectReaderTests-173975595 None] Created reservations ['bc7e2d7d-796e-4955-9397-970b821c25ce', '5ddc9346-32a1-46c8-9aa6-feb1aa7fce2c', '8de29319-4298-49a8-bd8b-37a2603a22cc', 'a4f6c02d-ba30-48e7-9233-5777f05970c8'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:05:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7ccff5cc-05e9-4cd0-8119-41f332ccc402 tempest-ProjectReaderTests-173975595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7ccff5cc-05e9-4cd0-8119-41f332ccc402 tempest-ProjectReaderTests-173975595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:42 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7ccff5cc-05e9-4cd0-8119-41f332ccc402 tempest-ProjectReaderTests-173975595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:05:42 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-7ccff5cc-05e9-4cd0-8119-41f332ccc402 tempest-ProjectReaderTests-173975595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:05:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-7ccff5cc-05e9-4cd0-8119-41f332ccc402 tempest-ProjectReaderTests-173975595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7ccff5cc-05e9-4cd0-8119-41f332ccc402 tempest-ProjectReaderTests-173975595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:42 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:05:42 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:42 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-7ccff5cc-05e9-4cd0-8119-41f332ccc402 tempest-ProjectReaderTests-173975595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.255s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:42 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-7ccff5cc-05e9-4cd0-8119-41f332ccc402 tempest-ProjectReaderTests-173975595 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:05:42 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-7ccff5cc-05e9-4cd0-8119-41f332ccc402 tempest-ProjectReaderTests-173975595 None] Deleted volume successfully. Sep 10 20:05:42 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-7ccff5cc-05e9-4cd0-8119-41f332ccc402 tempest-ProjectReaderTests-173975595 None] Lock "cinder-c452b391-981a-4515-91f9-68b3982f2cea-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:05:42 devstack cinder-volume[88093]: DEBUG cinder.volume.flows.manager.create_volume [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88093) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:05:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] Flow 'volume_create_manager' (ac23eb2b-9b72-430f-8a92-389033ecb0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:05:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20244286-999a-4dfe-8d7a-0113575f24da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20244286-999a-4dfe-8d7a-0113575f24da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1593128307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05ac5df2-f152-4405-aa9f-37a690b7e9f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c6b523d66d4dd7a4ff52cab9414e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:05:43Z,use_quota=True,user_id='2fa24792cea4402fa4d0236b3d4ecf07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80617ba0-c5ff-418f-9ade-25d1fdf88a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80617ba0-c5ff-418f-9ade-25d1fdf88a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78577f78-976d-4d1b-8c44-7fe0f5a3f103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78577f78-976d-4d1b-8c44-7fe0f5a3f103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05ac5df2-f152-4405-aa9f-37a690b7e9f4', 'volume_name': 'volume-05ac5df2-f152-4405-aa9f-37a690b7e9f4', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a9d2114-98be-44ba-8626-949719dcbf57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a9d2114-98be-44ba-8626-949719dcbf57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:42 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a7daf4-6d61-4966-bf66-d7624054e7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:42 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] Volume 05ac5df2-f152-4405-aa9f-37a690b7e9f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05ac5df2-f152-4405-aa9f-37a690b7e9f4', 'volume_size': 1} Sep 10 20:05:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:42 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1593128307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05ac5df2-f152-4405-aa9f-37a690b7e9f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c6b523d66d4dd7a4ff52cab9414e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:05:43Z,use_quota=True,user_id='2fa24792cea4402fa4d0236b3d4ecf07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1),volume_type_id=3f237b61-7fc1-4bb3-8c5b-41dbc5536fe1)}" {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:05:42 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.remotefs [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] Creating volume 05ac5df2-f152-4405-aa9f-37a690b7e9f4 {{(pid=88093) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:05:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:42 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:05:42 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:05:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:42 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] Selected osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 as target Quobyte volume. {{(pid=88093) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 20:05:42 devstack cinder-volume[88093]: INFO cinder.volume.drivers.remotefs [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] casted to osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3 Sep 10 20:05:42 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-05ac5df2-f152-4405-aa9f-37a690b7e9f4 1073741824 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:42 devstack sudo[108328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-05ac5df2-f152-4405-aa9f-37a690b7e9f4 1073741824 Sep 10 20:05:42 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:43 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-05ac5df2-f152-4405-aa9f-37a690b7e9f4 1073741824" returned: 0 in 0.388s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-05ac5df2-f152-4405-aa9f-37a690b7e9f4 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:43 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-05ac5df2-f152-4405-aa9f-37a690b7e9f4 Sep 10 20:05:43 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:43 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-05ac5df2-f152-4405-aa9f-37a690b7e9f4" returned: 0 in 0.246s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:43 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'} {{(pid=88093) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:05:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a7daf4-6d61-4966-bf66-d7624054e7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05ac5df2-f152-4405-aa9f-37a690b7e9f4', 'volume_size': 1}' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4fd0aa5-a622-4a2a-93bf-5a72a3d46afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:43 devstack cinder-volume[88093]: INFO cinder.volume.flows.manager.create_volume [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] Volume volume-05ac5df2-f152-4405-aa9f-37a690b7e9f4 (05ac5df2-f152-4405-aa9f-37a690b7e9f4): created successfully Sep 10 20:05:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4fd0aa5-a622-4a2a-93bf-5a72a3d46afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88093) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:43 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] Flow 'volume_create_manager' (ac23eb2b-9b72-430f-8a92-389033ecb0ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88093) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:05:43 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-f197713b-7a95-4c9f-a9f8-e50a981d2fae tempest-ProjectReaderTests-173975595 None] Created volume successfully. Sep 10 20:05:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3ca0f2ba-5a11-4368-9d35-b593a36df96f tempest-ProjectReaderTests-173975595 None] Acquiring lock "cinder-05ac5df2-f152-4405-aa9f-37a690b7e9f4-delete_volume" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:05:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3ca0f2ba-5a11-4368-9d35-b593a36df96f tempest-ProjectReaderTests-173975595 None] Lock "cinder-05ac5df2-f152-4405-aa9f-37a690b7e9f4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:05:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3ca0f2ba-5a11-4368-9d35-b593a36df96f tempest-ProjectReaderTests-173975595 None] Acquiring lock "cinder-quobyte-05ac5df2-f152-4405-aa9f-37a690b7e9f4" by "delete_volume" {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:05:43 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3ca0f2ba-5a11-4368-9d35-b593a36df96f tempest-ProjectReaderTests-173975595 None] Lock "cinder-quobyte-05ac5df2-f152-4405-aa9f-37a690b7e9f4" acquired by "delete_volume" :: waited 0.013s {{(pid=88093) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:05:43 devstack cinder-volume[88093]: DEBUG oslo.privsep.daemon [-] privsep: reply[29943018-e6b6-44ac-b885-4b1a091649bf]: (4, 'qcow2') {{(pid=89615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:05:43 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3ca0f2ba-5a11-4368-9d35-b593a36df96f tempest-ProjectReaderTests-173975595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-05ac5df2-f152-4405-aa9f-37a690b7e9f4 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:44 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-05ac5df2-f152-4405-aa9f-37a690b7e9f4 Sep 10 20:05:44 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:44 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3ca0f2ba-5a11-4368-9d35-b593a36df96f tempest-ProjectReaderTests-173975595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-05ac5df2-f152-4405-aa9f-37a690b7e9f4" returned: 0 in 0.358s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3ca0f2ba-5a11-4368-9d35-b593a36df96f tempest-ProjectReaderTests-173975595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-05ac5df2-f152-4405-aa9f-37a690b7e9f4 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:44 devstack sudo[108342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-05ac5df2-f152-4405-aa9f-37a690b7e9f4 Sep 10 20:05:44 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:44 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3ca0f2ba-5a11-4368-9d35-b593a36df96f tempest-ProjectReaderTests-173975595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3/volume-05ac5df2-f152-4405-aa9f-37a690b7e9f4" returned: 0 in 0.249s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3ca0f2ba-5a11-4368-9d35-b593a36df96f tempest-ProjectReaderTests-173975595 None] Lock "cinder-quobyte-05ac5df2-f152-4405-aa9f-37a690b7e9f4" released by "delete_volume" :: held 0.645s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:05:44 devstack cinder-volume[88093]: DEBUG cinder.quota [None req-3ca0f2ba-5a11-4368-9d35-b593a36df96f tempest-ProjectReaderTests-173975595 None] Created reservations ['eff8b895-6636-4b68-9d85-71b074a91f59', 'f5744e09-1162-45e3-bfc7-2aded855d6c6', '5dd5c99b-5c66-4564-a117-67ce326ed9c9', '737271bd-c63f-45ed-8338-8f5c85959b9e'] {{(pid=88093) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:05:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3ca0f2ba-5a11-4368-9d35-b593a36df96f tempest-ProjectReaderTests-173975595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3ca0f2ba-5a11-4368-9d35-b593a36df96f tempest-ProjectReaderTests-173975595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:44 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3ca0f2ba-5a11-4368-9d35-b593a36df96f tempest-ProjectReaderTests-173975595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:05:44 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-3ca0f2ba-5a11-4368-9d35-b593a36df96f tempest-ProjectReaderTests-173975595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:05:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-3ca0f2ba-5a11-4368-9d35-b593a36df96f tempest-ProjectReaderTests-173975595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3ca0f2ba-5a11-4368-9d35-b593a36df96f tempest-ProjectReaderTests-173975595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:44 devstack sudo[108345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:05:44 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:44 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:44 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-3ca0f2ba-5a11-4368-9d35-b593a36df96f tempest-ProjectReaderTests-173975595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.254s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:44 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-3ca0f2ba-5a11-4368-9d35-b593a36df96f tempest-ProjectReaderTests-173975595 None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:05:44 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-3ca0f2ba-5a11-4368-9d35-b593a36df96f tempest-ProjectReaderTests-173975595 None] Deleted volume successfully. Sep 10 20:05:44 devstack cinder-volume[88093]: DEBUG cinder.coordination [None req-3ca0f2ba-5a11-4368-9d35-b593a36df96f tempest-ProjectReaderTests-173975595 None] Lock "cinder-05ac5df2-f152-4405-aa9f-37a690b7e9f4-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=88093) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:05:54 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=27,cinder:UPDATE=44,cinder:INSERT=9,cinder:DELETE=3 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:05:54 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:UPDATE=44,cinder:SELECT=29,cinder:INSERT=11,cinder:DELETE=5 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:06:03 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:06:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:06:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:06:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3': None} {{(pid=88093) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 20:06:03 devstack cinder-volume[88093]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-635ddf41-d6c8-47b5-845e-74d42574eba3'] {{(pid=88093) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 20:06:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88093) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:06:03 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:04 devstack sudo[108549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3 Sep 10 20:06:04 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:04 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:04 devstack cinder-volume[88093]: DEBUG oslo_concurrency.processutils [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0526c75bb276f71a7d2276de400db0e3" returned: 0 in 0.244s {{(pid=88093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:04 devstack cinder-volume[88093]: DEBUG cinder.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Notifying Schedulers of capabilities ... {{(pid=88093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:06:04 devstack cinder-volume[88093]: DEBUG oslo_service.periodic_task [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] Running periodic task VolumeManager._thread_info {{(pid=88093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:06:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread count: 28 {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:06:04 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-f1b19fbe-3f83-44bd-b430-7bc6ec072efe None None] thread info: [<_MainThread(MainThread, started 138417491665024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}